Annals of Mathematics, 148 (1998), 1067-1133 



oo 

> 
o 



X 



On the classification of unitary 
representations of reductive Lie groups 

By SusANA A. Salamanca- RiBA and David A. Vogan, Jr.* 



Table of Contents 



Introduction 

1. Projections on convex cones 

2. Classification by lowest i^-types 

3. Relation to the unitary classification 

4. Relation to ordinary parabolic induction 

5. The reduction step in the classification 

6. The set B^{G) of unitarily small if-types 

7. Unitarily small K-types and the Dirac operator 

8. Topology of the unitary dual 
^ ' References 

On . Introduction 
00 

Suppose G is a real reductive Lie group in Harish-Chandra's class (see [6, 
§3]). We propose here a structure for the set n„(G) of equivalence classes of 
00 ■ irreducible unitary representations of G. (The subscript u will be used through- 
^ [ out to indicate structures related to unitary representations.) We decompose 
' Ilu{G) into disjoint subsets with a (very explicit) discrete parameter set A^ji 

g (0.1) n„(G)= U ^^(G). 

• • ■ A„eA„ 
> . 

Each subset is identified conjecturally (Conjecture 0.6) with a collection of 
unitary representations of a certain subgroup G{Xu) of G. (We will give strong 
9^ ', evidence and partial results for this conjecture.) In this way the problem of 
classifying n„(G) would be reduced (by induction on the dimension of G) to 
the case G{Xu) = G. 

Before considering the general program in more detail, we describe it in 
the familiar case G = SL(2,M). (This example will be treated more com- 
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pletely in Example 6.2 below.) The parameter set is Z. If n is a nonzero 
integer, then G{n) = S0(2), and n"(G) consists of a single discrete series rep- 
resentation (with Harish-Chandra parameter n + sgnn and lowest S0(2)-type 
n + 2sgnn). The corresponding representation of S0(2) is the character usu- 
ally parametrized by n. If n = 0, then G(0) = SL(2,]R), and n„(G) consists of 
all the remaining unitary representations: those containing an SO (2) character 
parametrized by 0, ±1, or ±2. (These are the principal series, the complemen- 
tary series, the trivial representation, and the first two discrete series.) 

At first glance it might appear natural to separate also the first two dis- 
crete series as isolated points in the parametrization. But recall that these 
representations are not isolated in the unitary dual of SL(2, M); rather they are 
limits of complementary series. The decomposition we have given is consistent 
with the topology of Ilu{G), and separating the first two discrete series would 
not be. 

As the example of SL(2,R) indicates, our "reduction" to the case G{\u) 
= G is in some ways not very powerful; almost all of the interesting phenomena 
are swept into that case. Nevertheless there is some content in these ideas. 
In a separate paper, the first author will show how to use them to deduce 
an old conjecture classifying unitary representations with sufficiently regular 
infinitesimal character. 

We turn now to a description of the decomposition (??) in general. Choose 
a Cartan involution 6 of G, with fixed points K a maximal compact subgroup 
of G. The real Lie algebra go then acquires a Cartan decomposition 



with po the —1 eigenspace of (the differential of) 0. The complexification of go 
is written 



similar notation is used for other groups. Fix a nondegenerate G-invariant, 

^-invariant symmetric bilinear form ( , ) on negative definite on aiid 
positive definite on pQ. We will use the same notation for the complexification 
of ( , ) (a complex- valued form on g), as well as its various restrictions and 
dualizations. 

Our partition of representations of G is in terms of their restrictions to K; 
so we begin by recalling the highest weight theory for representations of K. 

Fix a maximal torus T*^ C K. The abelian group T*^ of characters of T'^ 
will be identified (by passing to differentials) with a lattice of imaginary- valued 
linear functionals on the real Lie algebra: 



(0.2a) 



00 = ^0 +Po, 



(0.2b) 



g = go «)m C; 



(0.3a) 
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Because the form ( , ) was chosen to be negative definite on to, it is positive 
definite on ?(tQ)*. The roots of T'^ in t and the weights of T"^ in g are characters 
of T'^, and so will be regarded as elements ofi{i^)*. Choose a system of positive 
roots 

(0.3b) A+{t,e)(zA{t,e). 

The Weyl group of T'^ in K is by definition the normalizer of T'^ in K divided 
by the centralizer: 

(0.3c) W{K,T'') = Nk{T'')/Zk{T''). 

Since K need not be connected, this group may be larger than the Weyl group 
W{t,i^) of the root system. Obviously W{K,T'^) acts on the root system 
A(t, t'^), so we can define 

(0.3d) R{G) = {we W{K, T") \ u;A+(€, t^) = A+(€, t^^)} 

(see [16, Def. 5.1.2]). The notation is chosen to reflect the fact that R{G) 
is closely related to the i?-group of Knapp and Stein. Notice that if G is 
connected, then R{G) is trivial. There is a semidirect product decomposition 

(0.3e) W{K, T") = R{G)W{t, f) 

with the second factor normal. Each root a in A(fi, f^) corresponds to an 
eigenspace ia of Ad(r'^) on the complexified Lie algebra. We define 

(0.3f) nj= b« = nt + f; 

aeA+(«,t=) 

this is a Borel subalgebra of t. 

Lemma 0.1 (See [16], Prop. 5.1.9). Using the notation of (0.3), suppose 
V is a finite- dimensional complex representation of the Lie algebra t. The set 
of highest weights of V is by definition the set of weights of acting on , 

a subset of (f^)* . 

a) // V is an irreducible representation of t, then F"' has dimension one, so 
V has exactly one highest weight. 

b) The element fj, G (f^)* is the highest weight of an irreducible representation 
of 6 if and only if fj, is dominant integral for t: that is, 

2{fi,a)/{a,a) e N 

for allae A+it,^). 

c) Suppose V is a finite- dimensional irreducible representation of K. Then 
the collection of highest weights of V is a single orbit of R{G) on C 

in^r (cf. (0.3d)). 



1070 



SUSANA A. SALAMANCA-RIBA AND DAVID A. VOGAN, JR. 



Write 

(0.4a) ^1 = qI^ =tT^ =^c^^c^ 

a fundamental Cartan subalgebra of go- We will be interested not so much in 
the roots of \}'^ in g as in their restrictions to i'^: the nonzero weights of T'^ on 
g. Define 

(0.4b) A(p, t'^) = set of nonzero weights of T'^ on p. 

These weights all occur with multiplicity one. Define 

(0.4c) A(g,n = A(p,nuA(«,n, 

a subset with multiplicities in i(to)*- One can find fairly detailed structural 
information about this set for example in [15, §2]. We mention here only a 
few highlights. First, A(g, t'^) is a (possibly nonreduced) root system. The 
elements having multiplicity one are the restrictions of imaginary roots of t)'^; 
each is compact or noncompact. The roots having multiplicity two are the 
restrictions of complex roots; each corresponds to one root in I and one in p. 
The Weyl group VF(g,t'^) of A(g,t'^) may be identified with the stabilizer of t*^ 
in W{q, f)*^); it contains WiK^T"). 

Whenever u C g is a T'^-invariant subspace, we write A(u, t'^) for the set 
of weights of T'^ in u, counted with multiplicities. Define 

(0.4d) 2p(u)= 7e^(t8)*. 

7eA(u,t<:) 

As a character of T'^, this is the determinant of the adjoint action on u. As a 
weight for the Lie algebra i^, it is the trace of the adjoint action on u. We will 
make particular use of 

(0.4e) 2p(nt) = 2pc, 

the sum of the positive roots of T'^ in 6 (see (0.3)). 

We turn now to the definition of the partition 0.1 of the unitary dual. We 
will say more about the motivations behind the construction in Section 2, but 
here we mention just three primary sources: the notion of lowest iiT-type in [15] ; 
the geometric reformulation of that notion by Carmona in [3]; and a charac- 
terization used by the first author of the lowest K-types of the representations 
A^{\) studied in [18]. 

Fix a highest weight /x G i(io)*- Choose a system of positive roots A+(g, i'^) 
for A(g, i'^) making /i + 2pc dominant: 



(0.5a) 



(M + 2pe,7)>0, 7eA+(g,t<=). 
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Because is dominant for K and 2pc is dominant and regular, A"''(g,t'^) nec- 
essarily contains A+(t, t'^). Define 

(0.5b) 2p= Yl 7, 

7eA+(0,t=) 

the sum of the positive roots. This positive system defines a positive Weyl 
chamber 

(0.5c) C = {cpe i(tS)* I {cP, 7) > (7 G A+(0, em. 

This is a closed convex cone in the Euclidean space ^(t^)*. We may therefore 
define a projection P from i(to)* onto C: Pcf) is the unique element of C closest 
to (f). (This classical construction will be considered carefully in Section 1.) 
Using P, we can now define 

(0.5d) A„(/x) = P(/x + 2pe-2p). 

This is an element of the positive Weyl chamber C C it^; we will see in Propo- 
sition 1.4 that it is independent of the choice of positive root system subject 
to (0.5a). By (0.5a), p, + 2pc lies in C; so by definition of P, 

|A„(/x)-(/x + 2pe)| < \2p\. 

Consequently the distance from p, to \u{p) may be bounded independently of 
p, (say by |2p| + |2/9c|)- Because the weights p lie in a (discrete) lattice in z(to)*, 
it follows that the set 

(0.5e) A„ = {\u{p), p^T^ dominant} 

is discrete in ^(to)*• It is very easy to check that the group R{G) acts on A„. 
We can now define the decomposition (0.1). 

Definition 0.2. Fix A„ G A„. The set of K-types attached to A„ is 
P^"(G) = {5eK\6hasa highest weight p eT'^ such that Au(/x) = A^}. 

The set of unitary representations of G attached to A„ is 

n^"(G) = {iTT,nn) e UuiG) I TT has a lowest isT-type in P^"(G)}. 

It will sometimes be convenient (especially in our consideration of the Fell 
topology in Section 8) to abuse notation by writing 

A«(7r) = A„ 

when TT G 11^" (G). The difficulty is that tt may belong to several different 
nn"(G). Corollary 0.4 below says that A„(7r) is well-defined as an orbit of 
R{G), but not (unless G is connected) as an element of i{i^)*. 
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The definition of lowest K-type is given in [15, Def. 5.1], or [16, Def. 
5.4.18]; we will recall it in Section 2. 

Proposition 0.3. Suppose and fi' are highest weights of lowest K- 
types of a single irreducible representation of G. Then the weights Xu{lJ') and 
A„(/x') lie in the same orbit of R{G) (cf. (0.3)). 

We will prove this at the end of Section 3. 

Corollary 0.4. Suppose and A^ belong to A„ (cf. (0.5)). // A„ 

\ A' 

and A^ belong to the same orbit of R{G), then 11^" (G) = Ilu^{G). If not, then 
n^" (G) and Uu" (G) are disjoint. 

To get a partition as described in (0.1), we could, of course, replace A„ 
by a fundamental domain for the action of R{G); but since there is no natural 
choice for such a fundamental domain, it is more convenient for us to leave 
matters in this form. 

Next, we want to describe the group G{\u) discussed after (0.1). The root 
space decomposition of t implies that 

«o = tSe[t8,fio], 

and therefore that 

(0.6a) 0o = t§©[t[),6o]©Po- 

By means of this decomposition any linear functional on tg extends canonically 
to 00) by making it zero on the other summands. In this way we can identify 
i{i^)* naturally as a subspace of ig^: 

(0.6b) i{i^r-^i9*o. 

The group G acts on ig^ by the coadjoint action. In the same way T'^ (or even 
its normalizer in G) acts on itg, and the inclusion 0.6(b) is T'^-equivariant. 
Since T'^ is abelian, it follows that T'^ acts trivially on the image. For any 
A G i(to)* C iQQ, define 

(0.6c) G{X) = isotropy group at A for the G action; 

this is a subgroup of G containing T^. It is easy to check that the Cartan 
involution 9 preserves G(A); and that G{X) is a reductive group in Harish- 
Chandra's class, with Cartan involution 9\g{x)- 
The set of roots of in G(A) is 

(0.6d) A(5(A),t'=) = {je A{g,t'^) \ (7, A) = 0}. 

We can therefore construct a 0-stablc parabolic subalgebra q(A) = g(A) + u(A) 
by the following requirement (compare [16, Def. 5.2.1], and [9, Prop. 4.76]): 

(0.6e) A(u(A),t'=) = {7 G A(fl,t'=) | (7, A) > 0}. 
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Using the parabolic subalgebra q(A), we define functors of cohomological 
parabolic induction Cj{\) carrying (g(A), G(A) niC)-modules to (fl, K)-modules 
(see [9, §5.1], or [16, Def. 6.3.1]). These are most interesting in the degree 

(0.6f) S = dim(u(A)n€). 

At the same time, we have jCj^{\) carrying (G(A) nEr)-modules to IC-modules 
([9, §5.6]). 

Proposition 0.5. With notation as in Definition 0.2 and (0.6), the 
functor Cg {\u) implements a bijection from B^"{G{Xu)) onto B^^{G). 

We will prove this in Section 3 (Proposition 3.1). The aim of this paper 
is a corresponding result for unitary representations: 

Conjecture 0.6. With notation as in Definition 0.2 and (0.6), the functor 
C'Si^u) implements a bijection from n^"(G(A„)) onto 11^" (G). 

In Section 5 we will explain a program for proving this conjecture, reducing 
it to the more elementary Conjecture 5.7'. We present strong evidence for the 
validity of this latter conjecture, including Proposition 7.12 (which is a partial 
result towards it) and Theorem 5.9 (which provides moral support for the 
formulation of the conjecture). The program leads to an alternative description 
of the subsets njJ"(G) (Th eorem 5.8(c)). This description will imply that each 
is an open and closed subset of Iiu{G), and that the bijection in Conjecture 
0.6 is a homeomorphism in the Fell topology. We will examine these issues in 
Section 8. 

1. Projections on convex cones 

In this section we recall some elementary general results about projections 
on convex cones. They will be applied to positive Weyl chambers in i(to)*, 
with notation as described in the introduction. The ideas and the exposition 
are taken from [3]. Throughout this section, V will be a finite-dimensional 
real vector space, endowed with a positive definite inner product ( , ). Write 
\v\ = {v,v)^/'^ for the corresponding Hilbert space norm on V. Let C be a 
closed convex cone in V. Write 

(1.1) C° = {vEV\ {v, c) > 0, for all c G C} 

for the dual cone; it is again a closed convex cone in V. 

Proposition 1.1 (See [3, Prop. 1.2]). Suppose v eV. Then there is 
a unique element cq of C closest to v. It may be characterized by any of the 
following equivalent conditions. 
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a) For any c € C , \v — co\ < \v — c\. 

b) For any c E C, {v — co,c — cq) < 0. 

c) The vector cq — v belongs to the dual cone C°, and {cq — v,co) = 0. 
We omit the elementary proof. 

Definition 1.2. In tlic setting of Proposition 1.1, tlic clement cq of C 
satisfying the equivalent conditions (a)-(c) is written Pv, the projection of v 
on C. 

We will need some additional properties of the projection P that depend 
on special properties of Weyl chambers. We therefore assume for the rest of 
this section that we are given a (possibly nonreduced) root system 

(1.2a) A c V", 

and a set of positive roots 

(1.2b) A+ c A. 

We do not assume that A spans V. Write for the linear span of A in 
y, and Vz for its orthogonal complement. (The subscripts s and z stand for 
"semisimple" and "central.") Write 

(1.2c) n = {«!,..., aJcA+ 

for the simple roots; these form a basis of Vg. Write for the dual basis of 
fundamental weights: 

(1.2d) {^,^aj) = 5ij, {ii,v)=Q {veV,). 

The closed positive Weyl chamber is by definition 

(1.2e) C = {veV\{v,a)>Q (a G A+)} 

i=l 

Occasionally it will be useful to emphasize the dependence on the choice of 
positive root system; in that case we will write C(A+). The dual cone (cf. (1.1)) 
is 

I 

(1.2f) C'' = ^R^%, 

i=l 

the cone of positive roots. We will refer to this collection of notation and 
assumptions as "the setting 1.2." 

The main construction we use in this paper is (0.5d): to begin with a 
dominant weight, subtract a dominant weight, then project onto the positive 
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Weyl chamber. The following lemma will lead to several important properties 
of this construction. 

Lemma 1.3. In the setting 1.2, suppose ^ & C is a dominant weight, 
a eH is a simple root, and v E V. If {v, a) < 0, then 

{P{v-j),a) =0. 

Proof. By Proposition 1.1, we may write 
(1.3a) V — ^ = P{v — 7) — e{v, 7), 

with e(w,7) G C° orthogonal to P{v — 7). By 1.2(f), this means 
(1.3b) e(t;,7) = ^Qaj (cj > 0), 

i 

and Cj > implies (a,, P{v—^)) = 0. Now form the inner product of (1.3a) with 
a. The hypothesis on v and the dominance of 7 make the left side nonpositive. 
The first term on the right is nonnegative. If it is zero we are done; so we may 
assume it is positive. Then 

(1.3c) (a,e(i;,7)) > 0. 

Distinct simple roots have nonpositive inner product; so (1.3b) and (1.3c) imply 
that the coefficient Cj of a in (1.3b) must be strictly positive. We have already 
seen that this implies a is orthogonal to P{v — 7), as we wished to show. □ 

Proposition 1.4. In the setting 1.2, fix a dominant weight 7 G C 
Define a map from V to V as follows. Given v eV, choose a positive root 
system A+(f) making v dominant; write A'^{v) = crA"^, with a G VF(A) (the 
Weyl group). Define 

mv)=P{A+{v)){v-aj). 

Then Tj{v) is well-defined {independent of the choice of positive root system 
making v dominant). 

Recall that this result was used in (0.5d). 

Proof. Suppose wA'^{v) is another positive system making v dominant. 
Then v and w^^v are both dominant for A'^{v), and are conjugate by the Weyl 
group; so they coincide. Consequently w fixes v. Using wA'^{v) to define Tj{v) 
leads to 

P{wA'^ {v)){v — wu^) = P{wA'^{v)){wv — wa^) = w{P{A~^ {v)){v — C77)). 

By Chevalley's theorem (see for example [9, Prop. 4.146]) w is a product 
of reflections in simple roots orthogonal to v. By Lemma 1.3, each such simple 
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root is orthogonal to P{A'^{v))(v — £77). So w fixes P{A^{v)){v — (77), and we 
get finally 

P{wA+{v)){v - waj) = P{A+{v)){v - a-/), 

as we wished to show. □ 

The next result will be used in Section 2 to relate the parameter XuifJ') 
defined in (0.5) to the parameter A(/Lt) constructed in [15, Prop. 4.1] or [16, 
Prop. 5.3.3]. This will lead directly to Proposition 0.3, and to a variety of 
stronger properties of the sets 11^" (G). 

Proposition 1.5. In the setting 1.2, suppose v, 7, and S are all domi- 
nant weights in C. Then 

P{v-j-S) = P{P{v - 7) - S). 

Proof. Write 

(1.4a) P{v - = {v - + e{v,^), 

with e{v,j) G C° orthogonal to P{v — 7) (Proposition 1.1(c)). Next, write 

(1.4b) P{P{v - 7) - 5) = {P{v - 7) - 5) + eiPiv - 7), 5), 

with e{P{v — 7), (^) G C° orthogonal to P{P{v — 7) — (5). Combining these two 
equations gives 

(1.4c) P{P{v - 7) - 5) = (v - 7 - (5) + e{v, 7) + e{P{v - 7), 5). 

The last term on the right is orthogonal to P{P{v — 7) — (5) by 1.4(b). The 
second is orthogonal to P(u — 7) by 1.4(a), and therefore also to P{P{v — ^) — S) 
by Lemma 1.3. We have therefore shown that e(f,7) + e{P{v — 7), 5) is an 
element of C" orthogonal to P{P{v—j)—S). By Proposition 1.1(c), the formula 
in 1.4(c) now shows that 

P{v-j-S) = P{P{v - 7) - S), 

as desired. □ 

Corollary 1.6. In the setting 1.2, suppose 7 and 6 are dominant 
weights in C. Define maps T-y, etc., as in Proposition 1.4. Then 



The next result will be used in the characterization of the K-types at- 
tached to the parameter (Definition 0.2), for which Conjecture 0.6 gives no 
information. It is exactly analogous to [3, Cor. 2.13]. 
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Proposition 1.7. In the setting 1.2, suppose v and 7 are dominant 
weights in C. The following conditions are equivalent. 

a) P{v - 7) = 0. 

b) The weight 7 — f belongs to C"; that is, it is a sum of positive roots with 

nonnegative coefficients. 

c) The weight v belongs to the convex hull of the Weyl group orbit of'j. 

Proof. The equivalence of (a) and (b) follows from Proposition 1.1(c). 
That (b) and (c) are equivalent is a well-known aspect of the Cartan-Weyl 
theory of finite-dimensional representations; but since it is not easy to find a 
convenient reference, we give a proof. The main step is 

Lemma 1.8 ([16, Lemma 6.3.28]). Suppose 7 G C «s dominant and 
a G T^(A). Then there is an element e{a) G C° so that 

cr ■ 7 = 7 — e{a). 

Using this lemma, we proceed with the proof of the proposition. Suppose 
first that (c) holds; say v = YlaeW ^<^'^ ' "fi with c^ >0 and c^- = 1. Adding 
the equations in Lemma 1.8 gives 

v = j - ^Co-e(c7). 

cr 

Since C° is a convex cone, the last sum belongs to C°, as we wished to show. 

Conversely, suppose v is not in the convex hull of the Weyl group orbit of 
7. Then it is separated from the convex hull by a hyperplane. That is, there 
is an element X' eV so that 

(^;,A')>(a-7,A') {aeW). 

This inequality may be written as 

{v,X')>{j,a-X') {aeW). 

(We have replaced the variable a by a~^; since the inequality holds for all 
a G W, this is permissible.) Now write A for the dominant element of the 
Weyl group orbit of A', and A' = o"o • A. Then we have 

(i;,(7o • A) > (7,(7- A) (aeW). 

(This time wc have replaced a by aa^^ .) Applying Lemma 1.8 to the dominant 
weight A, we find ctq • A = A — e(cro), with e(cro) G C". Since v is dominant, it 
has a nonnegative inner product with e(cTo). So we get 

{v,X)> {j,a-X) (aeW). 

Taking a = 1, we find in particular 

{v-j,X)>0. 
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Since A is dominant, this inequality implies that 7 — f ^ C", as we wished to 
show. □ 

We can now give a convenient characterization of the map v 1— > P{v — 7). 

Corollary 1.9. In the setting 1.2, suppose v and 7 are dominant 
weights in C . Let Wq he the Weyl group of roots orthogonal to P{v — 7) {the 
stabilizer in W of P(v — 7)). Then v — P{y — 7) is dominant, and belongs to 
the convex hull of the Wq orbit of ^. 

Conversely, suppose that vq and 7 are dominant weights in C . Let Wq he 
the Weyl group of the roots orthogonal to vq . Suppose 70 is a dominant weight 
in the convex hull of the Wq orbit of 7. Then v = + 70 is dominant, and 
P(v - 7) = Vq. 

Proof. Write Aq for the system of roots orthogonal to P{v — 7). By 
Proposition 1.1(c), v — 7 — P{v — 7) is a sum of negative roots orthogonal to 
P{v — 7); that is, a sum of roots in A^. Now apply Proposition 1.7 to the 
root system Aq and the Aj^-dominant weight v — P{v — 7). The conclusion 
is that V — P{v — 7) belongs to the convex hull of the Wq orbit of 7. Clearly 
V — P{v — 7) is dominant for Aq^. The remaining set A+ — Aq" is permuted by 
Wq. Since 7 is dominant for these roots, the convex hull of Wq ■ 7 must be as 
well. 

The converse is similar but easier, and wc leave it to the reader. □ 

Because wc will most often use these results in the case 7 = p (half the 
sum of the positive roots), we will need a precise description of the convex hull 
in that case. 

Proposition 1.10 ([10, Lemma 5.9]). In the setting of 1.2, write p for 
half the sum of the positive roots. Then the convex hull of the Weyl group orbit 
of p coincides with the set R of all weights of the form 

r = J2 Ca«> (-1/2 <Ca< 1/2). 
aeA+ 

Equivalently, these are the weights 

r = p- ^ baa, (0 < 6a < !)• 

aeA+ 



2. Classification by lowest types 

In this section we recall part of the Langlands classification of admissible 
irreducible representations of G, as reformulated in [15], [16], and [3]. 
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Definition 2.1. Suppose G is a reductive group in Harish-Chandra's class. 
The admissible dual of G is the set Ha (G) of infinitesimal equivalence classes 
of irreducible admissible representations of G. Equivalently, Ila{G) may be 
identified with the set of equivalence classes of irreducible (g, i^)-modules ([16, 
Def. 0.3.8]; here K is a maximal compact subgroup of G as in 0.2.) . 

Most of the equivalence of these two definitions of Tla{G) is proved in 
[5]. What is missing there is the proof that every irreducible (g, i^)-module 
appears as the space of iiT-finite vectors in an admissible representation. This 
was proved for linear groups by Harish-Chandra, and in general by Lepowsky 
and Rader independently (see for example [19, Th. 3.5.6]). 

Definition 2.2 ([15, Def. 5.1] or [16, Def. 5.4.18]). Suppose X e n„(G) is 
an irreducible (g, if)-module. A lowest K-type of X is an irreducible represen- 
tation S e K such that 

a) S appears in the restriction of X to K, and 

b) if /i G «(to)* is a highest weight of 6 (Lemma 0.4), then (/x + 2pc,fJ, + 2pc) 
(notation 0.4(e)) is minimal subject to (a). 

Obviously the norm in Definition 2.2(b) is independent of the choice of 
highest weight of 5. 

The classification of admissible representations in [15] is based on the 
following fact. 

PROPOSITION 2.3 ([15, Prop. 4.1] or [16, Prop. 5.3.3]). Suppose fi G 
i(io)* is dominant integral for A+(t, t^). Choose a positive root system A"*" = 
A+(0,t'^) making n + 2pc dominant (cf. (0.5a)). Write p for the corresponding 
half sum of positive roots. Then there is a weight Xa{p) & ii^ with the following 
properties. 

a) The weight Aa(/i) is dominant for A+. 

b) There is an orthogonal collection (3i of positive imaginary roots such that 

i) Aa(Ai) = iJ: + 2pc - p + J2i (^iPi (0 < Cj < 1/2), and 

ii) (A„(m),A)=0. 

Corollary 2.4 ([3, Th. 2.10]). In the notation of Proposition 2.3, the 
weight Xaifj) is the projection of iJL+2pc — p on the cone C of dominant weights. 
In the notation of Proposition 1.4, \a{p) = Tp{^ + 2pc). Consequently Xa{P') 
is independent of the choice of A"*" making ji + 2pc dominant. 



Proof. Proposition 2.3 shows that \a{p) satisfies the conditions in Propo- 
sition 1.1(c) characterizing P(fx+2pc— p). The remaining assertions now follow 
from Proposition 1.4. □ 
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In analogy with (0.5e), we may now define 
(2.1) Ka = {Aa(/i), /V, G f" dominant}. 

The analogue of Definition 0.2 for admissible representations is: 

Definition 2.5. Fix Aa G A^. The set of K -types attached to \a is 
B^^^G) = {S e K \ S has & highest weight /x G such that Aa(/x) = Aa}. 
The set of admissible representations of G attached to Xa is 

n^-(G) = {tt G n„(G) I TT has a lowest i^-type in B^-{G)}. 

Just as in the case of Definition 0.2, we will abuse notation in Section 8 
by writing 

Aa(7r) = Aa 

when TT G Ha" (G). Again the difficulty is that tt may belong to several different 
Ua^iG). It follows from Theorem 2.9 below that Ao(7r) is well-defined as an 
orbit of i?(G). 

Proposition 2.6. With notation as in Definition 2.5, (0.6), and (0.4d), 
write Sa = dimu(Aa)n6. Then the functor Cg (Xa) implements a bijection from 

B^'^-P^<^'^))(G{Xa)) ontoB^'^iG). 

This is essentially proved in [16], although some careful inspection of def- 
initions is needed to verify that. Typical of the complications is the fact that 
the functors Cg{X) are not defined in [16]. Fortunately they are easy to de- 
scribe in terms of highest weights: roughly speaking, they add 2p{u{X) Dp) to 
the highest weight. Here is a more precise statement. 

Lemma 2.7 ([9, Cor. 5.72]). Suppose X G i(io)* is dominant for 
A+(«,t'=), so that u(A) n 6 C nt {notation (0.6e) and (0.3f)). Write R = 
dimu(A) n p, so that A^(u(A) n p) is a one- dimensional representation of 
G{X) f\K. Suppose Z is an irreducible representation of G{X) CiK, of highest 
weight denoted fJ-G(^x-) G T"^, and V is an irreducible representation of K. Then 

Hom;,(/:f (A)(Z), V) 2. Homc(,)nK(^ ® A^(u(A) n p), y"W"«). 

Define no = I^g{\) + 2/9(u(A) n p). // is dominant for K, then ev- 
ery irreducible constituent of Cg (A) {Z) has highest weight jiQ ■ If jJ-G is not 
dominant for K, then Cg {X){Z) = 0. 

Given this description of the functor Cg (A) , the translation from Lemma 
6.5.4 in [16] to Proposition 2.6 above is more or less straightforward; we omit 
the details. 
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In order to formulate the classification of admissible representations, we 
need one more ingredient. 

Proposition 2.8 ([9, Th. 5.80]). In the setting (0.6), suppose Z is a 
(0(A), G(A) r\ K) -module. Then there is a natural injective map of K -modules 

Bz:C^{X){Z)^Cs{\){Z). 

This map is called the bottom layer map for Z, for reasons explained in 
Section 5.6 of [9]. 

Theorem 2.9 ([16, Th. 6.5.12]). Suppose Xa G Aa (cf. (2.1)). Then 
there is a natural bijection 

(2.2) n^-''W^'"))(G(AJ)^n^(G) 

(Def. 2.5) defined as follows. Suppose Z^ G ^^~''^"^^"^^(G(A„)) IS an irre- 
ducible (0(Aa), G(\a) n K)-module. 

a) The set of lowest G{Xa) H K -types of Z^ consists precisely of those in 

b) The set of lowest K-types of CsS\a){Za) consists precisely of the image of 
the bottom layer map composed with £g^{Xa) on the lowest G{Xa)r\K -types 
of Za- 

Let &G{\a) ^ -^a" ''^"^'^"^^(G(Aa)) be an irreducible representation of the 
group G{Xa) fl K appearing in Za, and let 5 = i^^^{Xa){^G{\a)) corre- 
sponding representation of K in B^^iG) (Prop. 2.6). By Proposition 2.8, S 
must appear in CsS^a){Za)- 

c) There is a unique irreducible subquotient X of Csa{Xa){Za) containing the 
K-type S. 

d) The multiplicity of S in X is equal to the multiplicity of S in jCsa{^a){Za)j 

and to the multiplicity of S^i^Xa) ^a- 

e) The subquotient X is independent of the choice of the representation ^^(Aa) 
in Ba" ^^"'■'^"^^ (G(Aa)), subject to the requirement that (^G(Aa) occur in Z^. 
The bijection (2.2) sends Z^ to X. 

To construct the inverse map, suppose X is an irreducible (g, K)-module in 
U^-iG), having a lowest K-type S G B^-{G). Let Sg(x,) G Sa""''^"^^"^^(G(Aa)) 
be the corresponding irreducible representation of G{Xa)r\K (Prop. 2.6). Write 
Ra = dim(u(Aa) H p) as in Lemma 2.7. 

f) The representation Sg(\^) appears in the cohomology space H*{u{Xa),X) 
(o- (g(Aa),G(Aa) n K))-module) exactly as often as 6 appears in X; all 
occurrences are in degree Ra. 

g) There is a unique irreducible subquotient Za of H^"^ (u.{Xa) , X) containing 
the G{Xa) n K-type (^G(Aa)- 
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h) The subquotient Za is independent of the choice of 5 & B^°'{G), subject to 
the requirement that S occur in X. 

The inverse of {2.2) sends X to Za- 

Just as for Proposition 2.6, some translation is required to pass from the 
results in [16] to this one; but we omit the details. 

Because we are interested in unitary representations, we need to know how 
the bijection of Theorem 2.9 affects Hermitian forms. Here is the underlying 
machinery. 

Proposition 2.10 ([9, Th. 6.34]). In the setting of (0.6), suppose Z 
is a representation of G(A) fl K. Then any invariant Hermitian form on Z 
induces in a natural way a K -invariant Hermitian form on £^(A)(Z). This 
correspondence carries positive definite forms to positive definite forms, and 
negative definite forms to negative definite forms. 

Suppose Z is actually a {q{X),G{\) Ci K) -module. Then any invariant 
Hermitian form on Z induces in a natural way a (q, K) -invariant Hermitian 
form on Cs(\){Z). The bottom layer map Bz of Proposition 2.8 is unitary; 
that is, it respects these forms. 

Theorem 2.11. The bijection of Theorem 2.9 preserves Hermitian 

representations. Explicitly, suppose Za is an irreducible Hermitian 
idi^a), G(Aa) r\K)-module. Then the induced Hermitian form on Csa{^a){Za) 
descends to a nondegenerate form on the subquotient X containing the lowest 
K-types. 

Unfortunately, the analogue of Theorem 2.11 with "Hermitian" replaced 
by "unitary" is false. We know no examples in which Za is unitary and X is 
not; but the other direction fails spectacularly and often. One of the simplest 
examples has G = S0e(4, 1) and fi = the highest weight of the trivial rep- 
resentation of K. In this case G(\a) = S0(2) x S0e(2, 1), and Theorem 2.9 
relates spherical representations of G to representations of G{Xa) containing 
the S0(2) X S0(2) representation C_i (E> Cq. (The subscripts refer to the rep- 
resentations of S0(2), which we index by Z as usual.) Then the representation 
Za = C_i (8) of G{Xa) carries a Hermitian form of signature (1,2); but the 
corresponding irreducible representation X of G is the trivial representation. 

Here is how we propose to circumvent this problem. Suppose q = [ -|- u is 
a ^-stable parabolic subalgebra containing (\{Xa)- Using "induction by stages" 
theorems, we can get analogues of Theorems 2.9 and 2.11 relating certain 
representations of G to certain representations of L. These results are in some 
sense weaker than those above, because they reduce problems about G not 
to G{\a), but only to the larger group L. On the other hand, and for the 
same reason, a representation of L "remembers" more about the corresponding 
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representation of G than the representation of G{\a) does. For that reason, a 
unitary version of Theorem 2.11 has a better chance to be true. An extreme 
possibihty is to take q = g; then L = G, so the "reduction" from G to L is 
perfectly behaved but worthless. Our goal is to choose q large enough that the 
reduction is well-behaved, but small enough that it is interesting. 

We begin with formalities. Fix Aa G Aq. A weight A G i{io)* is called a 
singularization of Aq if for every root a G A{q, t'^), 

(2.3a) (A, a) > ^ (A„, a) > 0. 

That is, we require that A belong to the same closed positive Weyl chamber 
as Att, and that it lie on at least as many walls. Another way to say the same 
thing is: A should belong to every closed positive Weyl chamber containing Aa. 
A consequence of (2.3a) is 

(2.3b) (A„,a) =0^ (A,a) =0. 

By (0.6), 

(2.3c) u(A)cu(Aa), 0(Aa)C0(A), q(A„)cq(A). 

Because G is in Harish-Chandra's class, it follows also that 
(2.3d) G{Xa) C G(A). 

(To work with groups not in Harish-Chandra's class, this condition should be 
included as an additional assumption on A. We will eventually apply these 
formalities with A = A„, the weight defined by (0.5) for some n giving rise 
to Att. In that case (2.3d) is automatically satisfied.) We have direct sum 
decompositions like 

(2.3e) u(A„) = u(A) + (u(A„) n 0(A)), 

and similarly after intersection with t. We need two consequences of this 
decomposition. First, 

(2.3f) p{u{Xa)) = p(u(A)) + p{u{Xa) n 0(A)) 

as weights in i(to)* (cf. (0.4d)). Next, if we define 
(2.3g) Sa = dimu(Att) n S = dimu(A) n t, 

then 

(2.3h) dim(u(Att) n 0(A) ni) = Sa-S. 

We are going to be interested in cohomological induction functors related to 

three parabolic subalgebras: 

(2.4a) >C5„(A„): (0(A„), G(Att) n i^)-modules ^ (0, i^)-modules) 
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(defined in terms of tlic parabolic subalgebra q(Aa)); 

(2.4b) CsW- (0(A), G(A) n i^)-modules ^ (g, i^:)-modules 

(defined in terms of the parabolic subalgebra q(A)); and 

(2.4c) Csa-siKA)- (fl(A„),G(A„)nif)-moduIes ^ (0(A),G(A)nif)-moduIes 

(defined in terms of the parabolic subalgebra q(Aa) ng(A)). Similarly, we have 
the corresponding functors for compact group representations. 

Proposition 2.12 ([9, Th. 11.77). In the setting of (2.3) and (2.4), 
there are natural equivalences 

jOsM ^ Cs{X)o£s.-s{Xa,X), JO-liK) £f (A) o£g^5^(A„,A). 

These equivalences respect the bottom layer maps of Proposition 2.8 and the 
Hermitian forms of Proposition 2.10. 

What is established in [9] is a composition-of-functors spectral sequence. 
The equivalence here appears as a corner of that spectral sequence, because 
the various cohomological induction functors all vanish above the degrees in 
the proposition. (A careful reader may notice that the assertions about bottom 
layer maps and Hermitian forms are not actually stated or proved in [9]. In 
any case they are stated here only for moral support; we will make no use of 
them.) 

Using Proposition 2.12, it is a simple matter to extend Proposition 2.6 
and Theorems 2.9 and 2.11 to apply to q(A) instead of q(Aa). 

Theorem 2.13. Suppose Xa G A^, and there is fixed a singularization 
A ofXa (of. (2.3) and (2.4)). 

a) The functor C^{X) implements a bijection from Ba" ''^"^^■'^ (G(A)) onto 

bHg). 

b) There is a natural bijection 

n^-''("W)(G(A)) ^n^(G) 

defined as follows. Suppose that Z e ^^"^^"^^^^(G(A)) is an irreducible 
(g(A),G(A) n K)-module. Then the corresponding {Q,K)-module X is the 

unique irreducible subquotient of Cs{X){Z) containing K -types in B^'^{G). 
Conversely, given X G n^'"(G), put = dim(u(A)np). Then we assign to 
X the unique irreducible subquotient Z of H*(u{X),X) containing G{X) Ci 
K -types in Ba" ''^"^'^^^(G(A)); it appears in degree R. 

c) The bijection of (b) preserves Hermitian representations. 

d) Suppose Z e na"^^"^^^^(G(A)) is an irreducible Hermitian {q{X),G{X) PI 
K) -module. Then the image of the bottom layer map Bz (Prop. 2.8) maps 
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injectively to the irreducible subquotient X described in (b). On these 
K-types, the signature of the Hermitian form on X therefore corresponds 
precisely to the signature on Z . 

e) Suppose Z G n^"^^"^^^) (G(A)) is an irreducible (0(A), G(A) fl K)-module, 
and the infinitesimal character of Z corresponds by the Harish- Chandra 
isomorphism to a weight Assume that 

Re(0 + p(u(A)),a) > (a G A(u(A), f))). 

Then £s(A)(Z) is irreducible. 

f) Under the assumptions of (e), suppose also that Z is unitary. Then 
CsW{Z) is unitary. 

g) Under the assumptions o/(e), suppose also that 

(0 + p(u(A)),a) /O (Q:e A(u(A),{))) 
and that Cs{X){Z) is unitary. Then Z is unitary. 

Sketch of proof. For (a), Proposition 2.6 (applied to the groups G and 
G(A)) provides bijections 

/:g^5'^:S^-^("(^'^))(G(A„)) ^ S^-^("(^))(G(A)). 

Now Proposition 2.12 imphes that provides a bijection between the 

ranges of these two maps. The proofs of (b) and (c) are similar; we omit 
the details. Part (d) is the Signature Theorem of [9, Cor. 11.228]; (c) is the 
Irreducibility Theorem of [9, Th. 8.7]; and (f) is the Unitarizability Theorem 
of [9, Th. 9.1] or [17, Th. 1.3(a)]. Part (g) is [17, Th. 1.3(b)]. 



3. Relation to the unitary classification 

In this section we will relate the various sets defined for unitary represen- 
tations in Definition 0.2 with the classification by lowest X-typcs described in 
Section 2. We begin with a ii'-dominant weight /i € as in (0.5), and a posi- 
tive root system A"'"(g, V^) making // + 2pc dominant. Define p as in (0.5b), half 
the sum of the positive roots. Recall from Corollary 2.4 that in the notation 
of Proposition 1.4, 

(3.1a) \a{fi) = Tp{p + 2pc). 

The definition in (0.5d) may be written as 



(3.1b) 
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By Corollary 1.6, 

(3.1c) A„(/x) = Tp o Tp{ix + 2pc) = TpiXain)). 

Lemma 1.3 (or Proposition 1.4) now implies that 

(3. Id) A„(;Lt) is a singularization of Xa{l^) (notation 2.3). 

This information leads immediately to a relationship between the sets of 
K-types defined as in Definitions 0.2 and 2.5. 

Proposition 3.1. Use the notation o/(0.5), (2.1), and Proposition 1.4. 

a) Au = Tp{Aa). 

b) S„^''(G) = UA„.A.,T,(A.)=A„5a'"(G). 

c) In the notation of Theorem 2.13, the functor Cg (A^) implements a bijec- 
tion from 5^"(G(A„)) onto B^^{G). 

Proof. Parts (a) and (b) are immediate from (3.1c) and the definitions. 

For (c), we combine the description of B^^{G) in (b) with Theorem 2.13(a) 
(which applies because of (3. Id)). The conclusion is that C^^{Xy) implements 
a bijection from 

U s^-^("(^"))(G(A„)) 

Tp{\a) = Xu 

onto B^^{G). To complete the proof of (c), we need 

Lemma 3.2. In the setting of Proposition 3.1, suppose A^ G Aa(G(A„)). 
Then the following two properties are equivalent. 

a) ^p{0{A„))(Aa) = A„. 

b) There is a \a & Aa(G) such that Tp{Xa) = Xu, and A'„ = Aa — p(u(Au)). 

Assuming this lemma for a moment, we see that the last union may be 
rewritten as 

U i?^(G(A,)). 

A;.eAa(G(A„)) 

According to Proposition 3.1(b) (which we have already proved) this is pre- 
cisely i?^"(G(Au)), as we wished to show. □ 

Proof of Lemma 3.2. Suppose first that (b) holds. Fix a positive root 
system A"'"(0,t^) making A^ dominant, and write p for half the sum of the 
positive roots. Then 

(3.2a) p = p(u(A„))+p(g(AJ). 
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According to Proposition 1.1(c), the hypothesis that Tp(Xa) = Xu means that 
\u is dominant for A"'"(0,t'^), and that 

(3.2b) A„ = (A„ - p(u(A„))) - p{g{Xu)) + w, 

with w a nonnegative combination of positive roots orthogonal to A„. But this 
formulation also shows that if we set X'^ = Xa — p(u(Au)), then 

So (a) is satisfied. 

Conversely, assume (a) holds. Choose a positive root system A+(fl(Au), t*^) 
making A^ dominant. Define 

(3.2c) A+(fl,t^) = A+(s(A„),t)U A(u(A„),t^). 

Then (3.2a) stih holds. Define 

(3.2d) Xa = X', + p{u{Xu)). 

By Proposition 1.1(c), the assumption (a) may be written as in (3.2b). This 
looks at first as if it immediately implies (b) of the proposition. What is 
missing is this. To compute Tp{Xa), we must subtract from Aa half the sum 
of the positive roots for a system making Aa dominant. We do not yet know 
that Aa is dominant for A^(0,t'^). Here is a proof of that. Since A„ is central 
in G{Xu), we can apply Proposition 1.7 almost directly to the hypothesis (a). 
The conclusion is 

A'„ — Xu belongs to the convex hull of the Weyl group orbit of pidiXu))- 

Of course the Weyl group in question is for A(g(A„), t'^). This Weyl group fixes 
p{u{Xu))- We conclude that Aa may be written as a convex combination 

Aa = '^Cyj{Xu + Wp), 

with w running over the Weyl group of A(0(A„), f^). Each summand here has 
positive inner product with the roots in A(u(Au), f^), so Aa does as well. On the 
other hand it is immediate from (3. 2d) that Aa is dominant for A^(g(A„), t); so 
we conclude that Aa is actually dominant for A+(0,t'^), as we wished to show. 
Now (3.2b) does imply that Tp{Xa) = A„, which is (b). □ 

Proof of Proposition 0.3. Write 5 and 6' for lowest X-types of tt having 
highest weights p and p'. Define Aa = Xa{p), and Aa = Xa{p')- Use Theorem 
2.9 and the K-type S to write tt as a subquotient of some £,Sa{^a){Za)- Then 
S' must be a lowest K-typc of this cohomologically induced representation. By 
Theorem 2.9(b), 6' must also belong to B^'^{G). It is clear from Definition 
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2.5 (and Lemma 1.4) that this imphes that = r • Xa, for some r G R{G). 
Consequently (3.1c) imphes that 



In this section we consider the relationship between our results about 
cohomological induction and those formulated with ordinary parabolic induc- 
tion. We begin with the case to which Theorem 2.9 reduces the classification 
of admissible representations. 

Proposition 4.1. Suppose Xa G (cf. (2.1)), and that G{Xa) = G. 
Then G is quasisplit; that is, there is a Borel subgroup B'^ = T'^A^N'^ of G. 

The Levi factor = T'^A^ is a maximally split Cartan subgroup of G. After 
replacing B'^ by a conjugate, we may assume that the identity component Tq 
is contained in T^ (cf. (0.3)). Then the linear functional Xa vanishes on the 
orthogonal complement of C f^, so it makes sense to write Xa G «(to)*. An 
irreducible representation 7 G is said to be fine of type Xa if its differential 
is a multiple of Xa ■ 

a) Suppose 6 € B^''{G). Then the restriction of 5 to T'^ consists of fine 
representations of T'^ of type Xa, belonging to a single orbit ofW{G,H'i). 

b) The set B^'^{G) consists of all lowest K -types of the induced representa- 
tions Ind;^<j (7) , as 7 runs over fine representations of T^ of type A^. 

c) Suppose 6 € B^'^i^G), and X € n^° (G) is an irreducible admissible rep- 
resentation of lowest K-type 6. Let 7 be any representation of T'^ ap- 
pearing in the restriction of S. Then there is a character u E A"^ so 
that X is a Langlands subquotient of the principal series representation 
Indj-q j^qj^q{^ ® I') . In particular, the infinitesimal character of X has 
Harish- Chandra parameter {Xa,i^) G (f^)* + (a'^)*. 

This is [16, Prop. 5.3.26, Th. 4.3.16, and Th. 4.4.8]. Inspection of the 
proofs shows that what is claimed here does not use the assumption of abelian 
Cartan subgroups. (That is needed for example to show that the restriction of 
S to decomposes with multiplicity one.) 

We turn now to general representations. So let Xa G Aa{G). Proposition 
4.1 guarantees that G{Xa) is quasisplit. A little more precisely, Proposition 2.6 
guarantees that 



Kip') = Tp{X'a) = Tp{r ■ Xa) = r- Tp{Xa) = r ■ Au(//), 



as we wished to show. 



□ 



4. Relation to ordinary parabolic induction 



(4.1a) 



Aa = Aa - P(u(Aa)) 
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as in Proposition 4.1. Just as in the proposition, we may regard A^, A^, and 
p(u(Aa)) as weights in it(Aa)o. Now consider the centrahzer of A(Xa) in G. 
Because A{Xa) is the vector part of the Cartan subgroup H{Xa), this centrahzer 
has a Langlands decomposition 



Here M(Aa) is a ^-stable reductive subgroup of G containing T(Aa) as a com- 
pact Cartan subgroup. 

Proposition 4.2. In the setting 4.1, there are natural bijections among 
the following three sets. 

a) Fine representations of T{\a) of type A^ (Proposition 4.1); that is, irre- 
ducible representations ofT{Xa) of differential equal to a multiple of X'^. 

b) Irreducible representations of T{Xa) of differential equal to a multiple of 
Xa — /9(m(A)). Here the positive root system is the one for i{Xa) in Tn(Aa) 
making Xa dominant. 

c) Discrete series representations of M{Xa) of Harish- Chandra parameter Xa. 

Proof. This result is analogous to Proposition 6.6.2 in [16]. To construct 
the bijection between (a) and (b), consider the set of roots A(u{Xa),i){Xa))- 
The imaginary roots among these are precisely the positive roots of t(Aa) in 
m(Aa). The remaining roots occur in pairs {a,Oa). Choose one root from each 
of these pairs, and list the choices as {ai, ... , ttr}. Define 



Because a and 6a have the same restriction to T(Aa), the character r is inde- 
pendent of choices. Furthermore 



The bijection from (a) to (b) is just tensoring with r. The bijection from (b) to 
(c) is Harish-Chandra's parametrization of the discrete series. In the context 
of Section 2, the set in (c) turns out to be n^"(M(Aa)), and the bijection with 
(b) is precisely 2.2; that is, it is given by cohomological induction from T{Xa) 



(4.1d) 



G^(^«)=M(Aa)A(Aa). 



r = 



p{u{Xa)) = p{m{Xa)) + dr. 



to M(Aa). Details may be found in [9, §11.8]. 



□ 



We can now formulate the relationship between Theorem 2.9 and the 
parabolic induction version of the Langlands classification. 
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Theorem 4.3 ([9 , Th. 11.225]). Suppose we are in the setting of {2.2), 
and that the irreducible {q, K) -module X corresponds to Za- Use the notation 

of (4.1), and fix a character 7^ ® i/ of H{Xa) as in Proposition 4.1 so that 

G(X ) 

Za is a Langlands quotient 0/ Ind^^^" -j^, (7 i^)- Let 7 be the discrete series 
representation of M{\a) with Harish- Chandra parameter that corresponds 
to 7q in the bisection from (a) to (c) of Proposition 4.2. Choose a real parabolic 
subgroup P = M{Xa)A(\a)N ofG making Rez^ dominant for the a{Xa) -weights 
in n; and define = N f) G{Xa). Then 

CsAK) (lndSf,;5^,(7 C3 i^)) Ind^(7 u). 

In particular, X is a Langlands quotient o/Indp(7 u). 

This is stated without complete proof in [16, Th. 6.6.15]; it was essentially 
first proved in the unpublished second half of [15]. 

Recall that the tempered representations constitute the closure (in the Fell 
topology) of the support of the Plancherel measure. A tempered irreducible 
representation is unitary, but unitary representations need not be tempered. 

Corollary 4.4. The bijection of Theorem 2.9 preserves tempered rep- 
resentations. Explicitly, suppose Za G Ha" ^^^^^'^^\G{Xa)) is an irreducible 
tempered (g(Aa),G(Aa) H K)-module. Then Csa{^a)iZa) is an irreducible tem- 
pered {q, K) -module in Ila"-{G); and every such tempered representation arises 
in this way. 

Proof. The nature of the Langlands classification implies that a Lang- 
lands quotient is tempered if and only if the continuous parameter v is purely 
imaginary (see for example [8, Th. 8.53]). Theorem 4.3 says that the bijection 
of Theorem 2.9 preserves continuous parameters, so tempercdncss is also pre- 
served. For the rest, the infinitesimal character of Za is given by the weight 
(Aa — p(u(Aa)),i^) G f)(Aa)*. When v is purely imaginary, the dominance of 
Aa implies immediately that the condition in Theorem 2.13(e) is satisfied; so 
£,Sa{K){Za) is irreducible. □ 



5. The reduction step in the classification 

Theorem 2.13 and Proposition 3.1 together allow us to approach Con- 
jecture 0.6. To see what we have, we consider first the case of Hermitian 
representations. 

Definition 5.1. Suppose G is a reductive group in Harish-Chandra's class. 
The Hermitian dual of G is the set Ilh{G) of equivalence classes of irreducible 
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(g, K) modules endowed with nondegenerate invariant Hermitian forms. Here 
K is a maximal compact subgroup of G; and an equivalence is required to 
preserve the Hermitian form. 

Suppose A„ G Au (cf. (0.5)). The set of Hermitian representations of G 
attached to A„ is 

n^"(G) = {tt G UhiG) I TT has a lowest K-iype in B^^{G)} 

(cf. Definition 0.2). 

Proposition 0.3 immediately shows that these sets partition the Hermitian 
dual: 

PROPOSITION 5.2. Suppose Xu and X'^^ belong to A„ (cf. (0.5)). // A„ 
and A'„ belong to the same orbit of R{G), then n^"(G) = H^"(G). If not, then 
n^"(G) andU^'^iG) are disjoint. 

At this point it is useful to be a little more precise than we have been 
about the notion of signature. 

Definition 5.3. (See [17, Def. 1.4], or [9, Prop. 6.12].) Suppose X is an 
admissible representation of K (that is, locally finite with finite multiplicities), 
and ( , ) is a X-invariant Hermitian form on X. The signature of { , ) is a set of 
three functions {p, q, z) from K to the nonnegative integers, defined as follows. 
Suppose {S,Vs) is an irreducible representation of K. Fix a positive-definite 
invariant Hermitian form ( , )sonVs. Define 

X^ = RomK{Vs,X). 

This is a finite-dimensional vector space, of dimension equal to the multiplicity 
m{6) of S in X . There is a unique Hermitian form ( , on X^ characterized 
by the property 

{Tv,Sw) = {T,S)^{v,w)s {T,Se X\ v,w e Vs). 

The form ( , )^ may be diagonalized; and we define p((5) (respectively q{S), z{S)) 
to be the number of positive (respectively negative, zero) diagonal entries. 
These numbers are of course independent of the choice of diagonalization, and 
characterize the form ( , up to equivalence. Notice that 

m{6) = p{6) +q{5) + z{6). 

The form ( , ) on X is nondegenerate if and only if 2; = 0, and positive definite 
if and only ii q = z = 0. 

Theorem 5.4. Suppose A„ G A„ (cf. (0.5)). 
a) The functor Cg^{Xu) provides a bisection from B^^(G{Xu)) onto B^'^(G). 
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b) The set n^"(G(A„)) consists of all irreducible (^(Au), G{\u) H K)-modules 
endowed with an invariant Hermitian form, and containing at least one 
{G{\u) n K)-type in the set 5^"(G(A„)). 

c) There is a natural bijection 

n^(G(A))^n^(G) 

defined as follows. Suppose that Z G n^"(G(Au)) is irreducible as a 
{q{Xu),G{Xu) K) -module. Then the corresponding {g, K)-module X is 
the unique irreducible subquotient of Csui^u){Z) containing K -types in 
B^°- (G) . The Hermitian form on X is the one inherited from the one on 
Cs^{Xu){Z) induced from Z by Proposition 2.10. 

d) The bisections of (a) and (c) preserve signatures of Hermitian forms; that 
is, the signature on a K type in B^^ (G) of the Hermitian form on X is 
equal to the signature on the corresponding G(A„) fl K-type of the Hermi- 
tian form on Z. 

e) Suppose Z G n^"(G(A)) is an irreducible {q{Xu),G{X) D K)-m,odule, and 
the infinitesimal character of Z corresponds by the Harish- Chandra iso- 
morphism to a weight <^ G f)*. Assume that 

Re {4> + p(u(A„)), a) > (a G A(u(A„), f)). 

Then Csu{^u){Z) is irreducible. 

Proof. Part (a) is Proposition 3.1(c). For (b), the group G plays no role, 
so we may as well assume G = G(A„). One inclusion is obvious; so suppose X is 
an irreducible (g, X)-module containing a i^-type 5 G B^^{G). We must show 
that the lowest i^-typc 6' also belongs to B^'"{G). Write Z for the identity 
component of the compact part of the center of G. Then i'^ is the orthogonal 
direct sum of 3 and the span of the roots. Since G(A„) = G, the weight A^ is 
orthogonal to all the roots; so Au G zJq is just the differential of the character 
by which Z acts on 6. Since Z acts by the same character on S', we see that 
A^lj = Xu. This implies that 

(5-1) |A„| < |a;,|. 

Now we apply 

Lemma 5.5. Suppose X is an irreducible (g, K) -module of lowest K-type 
S' G Bu^(G), and 5 is any other K-type of X. Then 8 has a highest weight (i 
with 

A„(/x) = a; + Q', 

with Q' a sum with nonnegative coeffi.cients of roots o/i"^ in q(A^). In particular, 

{Xuifi),Xuifi)) > {X'^,X'J, 

with equality only if XuifJ-) = A(^. 
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We will give the proof in a moment. Assuming the result, we find that 
|Au| > |A^|. By 5.1, equality must hold. The condition for equality in the 
Lemma is = A^; so the lowest K-type 6' of X belongs to B^"{G), as we 
wished to show. 

Part (c) is (in light of (3.1)) just Theorem 2.13(b); part (d) is Theorem 
2.13(d); and part (e) is Theorem 2.13(e). □ 

Proof of Lemma 5.5. This is a variation on Lemma 6.5.6 in [16], which we 
will also use here. Fix a highest weight /x' of S' so that Au(/x') = A^, and define 
Aa = Aa(/i'). According to the proofs of Lemma 6.5.6 and Theorem 6.5.9 in 
[16] we can find a highest weight /x of (5 so that 

(5.2a) Xaifi) = \'a + Q'l, 

with Q' a sum with nonnegative coefficients of roots of in q(A(^). We want 
a relationship between A„(/i) and A^, so we rewrite both sides in those terms. 
Fix a positive root system (A+)' making A^ dominant, and write p' for half 
the sum of its positive roots. Then 5.2(a) becomes 

(5.2b) XuifJ,)+po = K + Q'i + p' -w'. 

Here w' is a nonnegative combination of roots in (A"*")' orthogonal to A(^. On 
the left we have used instead Corollary 1.9: po is a dominant weight in the 
convex hull of the Wo-orbit of p. By Proposition 1.10, we can write 

(5.2c) Po = p'- Yl (° ^ ^ 

a'G(A+)' 

Inserting this in (5.2b) gives 

(5.2d) Xu{p) = X'^ + Q[-w'+ Yl 

q'G(A+)' 

This has the form required in the lemma. The last inequality is an immediate 
consequence. □ 

We need one more definition. 

Definition 5.6 (16, Def. 5.4.11]). Suppose f)o is a 0-stablc Cartan subal- 
gebra of go- Write {)o = to + Oq for its decomposition into the +1 and — 1 
eigenspaces oi 6: to = i)o H to, and ao = l)o H Po- Any complex-valued linear 
functional 7 G t)* may then be written as 

7= (A,!/) Gt* + a*. 

Now make a further decomposition of 7 as 

7 = 71 +n2 = (Ai,z^i) + i{X2,i'2), 
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in such a way that 7j takes purely real values on ao, and purely imaginary 
values on to- That is, 

Xjeitl, iyj^a*Q, -fjeit*o + a*o. 

Define the canonical real and imaginary parts of 7 as 

RE 7 = 71 , IM 7 = 72 . 

If a G f)* is a root, then 

Re (7, a) 

and similarly for imaginary parts. 

One checks easily that the decomposition into canonical real and imag- 
inary parts commutes with the action of the Weyl group, and in fact with 
any automorphism that is inner for the complexified Lie algebra ([16, Lemma 
5.4.12]). 

Here is the main conjecture of this paper. 

Conjecture 5.7. Suppose A„ G A„ (cf. (0.5)), and that G(Xu) = G. Sup- 
pose is an irreducible Hermitian (0,K)-module (Definition 5.1). 
Let f) be a (^-stable Cartan subalgebra of go, and (/> G f)* a weight parametrizing 
the infinitesimal character of X by the Harish-Chandra isomorphism. Assume 
that the canonical real part RE cp does not belong to plus the convex hull 
of the Weyl group orbit of p. Then the signature of the Hermitian form on X 
must be indefinite on types in B^'^ (G) . 

The statement of this conjecture is complicated somewhat by the central 
weight Ay. Of course the center of g is more or less irrelevant to interesting 
statements about unitary representations. In particular, Conjecture 5.7 is 
equivalent to the following statement about semisimple groups. (This kind of 
reduction is discussed again in 6.1 below.) 

Conjecture 5.7'. Suppose G is a connected semisimple group in Harish- 
Chandra's class; and suppose X G n^(G) is an irreducible Hermitian {g,K)- 
module (Definition 5.1). Let f) be a ^-stable Cartan subalgebra of Qq, and 
(/) G f)* a weight parametrizing the infinitesimal character of X by the Harish- 
Chandra isomorphism. Assume that the canonical real part RE^ does not 
belong to the convex hull of the Weyl group orbit of p. Then the signature of 
the Hermitian form on X must be indefinite on if- types in B^{G). 

We will give some supporting evidence for this conjecture in Proposition 
7.12 below, which is based on Parthasarathy's Dirac operator inequality. We 
also formulate a conjectural sharpening of the Dirac operator inequality which 
would imply Conjecture 5.7' (Conjecture 7.19). 



= (RE7,a), 
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Theorem 5.8. In the setting of Theorem 5.4, assume that Conjecture 
5.7 is true for G(A„). Then the bijection of (c) preserves unitarity. More 
precisely, suppose f)o is a 6 -stable Cartan subalgebra of q{Xu)o- Write Wq for 
the Weyl group o/ f) mg(Au). 

a) The cohomological parabolic induction functor Csui^u) implements a bi- 
jection from n^"(G(A„)) onto 11^" (G). 

b) Assume that Z is an irreducible unitary {g{Xu),G{X)riK) -module contain- 
ing a {G{Xu) r\ K)-type in i?„"(G(A„)), and that the infinitesimal char- 
acter of Z corresponds by the Harish- Chandra isomorphism to a weight 
4>{Z) G f)*. Then RE(/)(Z) — A„ (cf. Definition 5.6) belongs to the convex 
hull of the Wq orbit of p{q{Xu))- 

c) Assume that X G n^"(G), and that the infinitesimal character of X cor- 
responds by the Harish- Chandra isomorphism to a weight (f){X) G f)*. 
Assume that KE(p{X) is dominant for the roots of f) in u(A„). Then 
KE(j){X) — [Xu + p(u(A„))) belongs to the convex hull of the Wq orbit of 
p(g(Au)). In particular, Tp(RE (f){X)) = A^. 

The last statement of (c) appears to recover A„ from the infinitesimal 
character of any representation in 11^" (G). It does not quite do that, however, 
since wc needed the weight <^(X) to satisfy a positivity condition determined 
by A^. At any rate we can recover the Weyl group orbit of A„. 

Before embarking on the proof of this result, we need a complement to 
Conjecture 5.7. 

Theorem 5.9. Suppose Xu G A„ (cf. (0.5)), and that G{Xu) = G. 
Suppose X G n^"(G) is an irreducible Hermitian {g, K) -module. Let f) be 
a 6-stable Cartan subalgebra of qq, and (/> G f)* a weight parametrizing the 
infinitesimal character of X by the Harish- Chandra isomorphism. Assume 
that the canonical real part RE ^ belongs to Xu plus the convex hull of the Weyl 
group orbit of p. Then X is unitary if and only if its Hermitian form is positive 
definite on K -types in B^^(G). 

Proof. There is no loss of generality in assuming that f) is the fundamental 
Cartan subalgebra. We use Theorem 1.5 of [17]. That provides irreducible tem- 
pered (g, i^)-modules Zi, . . . , Zp (of real infinitesimal character) and integers 
r^, . . . , r^, so that the signature of the Hermitian form on X is 

{^rt@K{Zi),Y.r-@K{Zi)). 

Here Qk{Z) denotes the formal K-character of Z. Fix a lowest K-iypc 6i of 
Zi, and a highest weight fii of Si. Write A^ = Xa{ni). 

Because Zi is tempered and has real infinitesimal character, Theorem 4.3 
shows that the infinitesimal character is given by the weight Aj. The proof 
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of Theorem 1.5 in [17] shows first of all that each Zi has the same central 
character as X; and second, that the infinitesimal character Aj must belong 
to the convex hull of the Wcyl group orbit of RE (/>. From these two facts we 
deduce that Aj must belong to A„ plus the convex hull of the Wcyl group orbit 
of p. Corollary 1.9 therefore implies that (in the notation of Proposition 1.4) 
T^p^^i) = ^u- By Corollary 1.6, it follows that Xuif^i) = A^, and therefore that 

For the proof of the theorem, "only if" is clear; so suppose X is not 
positive definite. This means that J2''^i^K{Zi) ^ 0. It follows that the lowest 
K-types of one of the must appear with nonzero multiplicity in this sum; 
that is, that the form on X is not positive on some Si. (For this it is enough to 
take I Ail minimal with r~ ^ 0. The absence of cancellation then follows from 
Theorem 6.5.9(b) in [16].) But we have just seen that 5i belongs to i?^"(G), 
as we wished to show. □ 

Proof of Theorem 5.8. Part (b) is an immediate consequence of Conjecture 
5.7. For (a), suppose X G n^"(G); write Z for the corresponding Hermitian 
representation in n^"(G(A„)) (Theorem 5.4(c)). By Theorem 5.4(d), the Her- 
mitian form on Z must be positive on the {G{Xu) H i^)-types in B^"(G(Au)). 
By Conjecture 5.7, the infinitesimal character of Z corresponds to a weight 
(piZ) G [)* with 

(5.3a) RE0(Z) = A„ + wo- 

Here wq is a weight in the convex hull of the Wq orbit of p{q{Xu))- By Theorem 
5.9, Z is unitary. Adding p{u{Xu)) to (5.3a) gives 

(5.3b) RE ^{Z) + p(u(A„)) = A„ + p(u(A„)) + wo- 

The right side here is strictly dominant on roots of I) in u(A„) (compare the ar- 
gument at the end of the proof of Lemma 3.2). By Theorem 5.4(e), CsuiXu)iZ) 
is irreducible. For the converse, suppose Z € n^"(G(A„)). By Conjecture 5.7, 
the infinitesimal character of Z satisfies (5.3a). We have seen that this implies 
the positivity condition in Theorem 2.13(e); so by Theorem 2.13(e) and (f), 
£s^(A„)(Z) is irreducible and unitary, as we wished to show. 

For (c), we may assume by (a) that X = Cs^{Xu)iZ), and that the in- 
finitesimal character of Z corresponds to a weight (t>{Z) satisfying (5.3a). Using 
Corollary 5.25 of [9] (or Prop. 6.3.11 of [16]) we find that the infinitesimal char- 
acter of X is represented by the weight 

(5.3c) ^{X) = ^{Z)+p{u{Xu)). 

We have seen above that RE^(X) is strictly dominant for the roots of [) in 
u(A„); so this (f){X) must coincide (up to the action of Wq) with the represen- 
tative chosen in (c). Now (5.3c) and (5.3b) together imply that 0(X) has the 
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property asserted in (c). This in turn implies that Tp(RE(p{X)) = Xu by (for 
example) Corollary 1.9. □ 

Corollary 5.10. Conjecture 5.7 (for the subgroup G{Xu) of G) implies 
Conjecture 0.6. 



6. The set B^(G) of unitarily small i^C-types 



Definition 6.1. Suppose G is a real reductive group in Harish-Chandra's 
class, and K is a maximal compact subgroup. A parameter € (cf. (0.5)) 
is called unitarily small if G{\y) = G (cf. (0.6)). The set of unitarily small 
parameters is written A^(G); the z stands for central. A highest weight fi ^T"^ 
is called unitarily small if A„(/i) is unitarily small. A representation 5 ^ K \s 
called unitarily small (with respect to G) if 5 has a unitarily small highest 
weight. The set of all unitarily small i^-types is written B^{G). 

This is the analogue of "small" ([16, Def. 5.3.24], or [15, Def. 5.1]); the 
change is that the weight \a{n) constructed in Proposition 2.3 has been re- 
placed by A„(/x). Because of (3. Id), unitarily small is a weaker condition than 
small. It is fairly easy to see from the definition and Proposition 1.1 that the 
trivial representation of K is always unitarily small. By contrast, the trivial 
representation is small in the sense of [16] if and only if G is quasisplit. 

Theorem 5.8 reduces the classification of unitary representations (at least 
modulo Conjecture 5.7) to the classification of sets 11,^" (G), with A^ unitarily 
small. By Theorem 5.4(b), membership in such a set is equivalent to containing 
a i^-type in B^^ (G). So Conjecture 5.7 reduces the classification of unitary rep- 
resentations to the classification of those containing a unitarily small K-type. 
That is one reason to understand such K-types as completely as possible. A 
second reason is that Conjecture 5.7 is again a statement about representations 
containing unitarily small K-types. 

For these reasons, we devote the next two sections to a series of character- 
izations of unitarily small K-types (Theorem 6.7, Corollary 6.12, Proposition 
7.1, and Proposition 7.17). We begin with some examples of the calculation in 
(0.5). 

Example 6.2. Suppose G = SL(2,M), and K = S0(2) = T", so that 
(a) ^ = r^~ZcK~?(tS)*. 

The set of roots of in g is 



(b) 



A(0,t<=) = {±2}; 
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(e) KifJ-n) = 



both of these are noncompact imaginary. Write Hn for the irreducible repre- 
sentation of K corresponding to the integer n. Because there are no compact 
roots, 2pc = 0. Therefore jLt„ + 2pc = fin is dominant for the positive root 
system 

(c) A+(0,t^) = {(sgnn)-2}; 

here we define sgnO = +1. The corresponding positive Weyl chamber C con- 
sists of the half line containing sgn n. The projection P on C is the identity 
on C, and sends the other half line to zero. Now 2p = 2 sgn n, so 

(d) Hn + 2pc-2p = n-2 sgn n. 

This belongs to C (and so is equal to A„ as long as |n| > 2. For smaller 
values of n it does not belong to C, so the projection on C is zero. To sum- 
marize: 

n — 2 sgnn, if \n\ > 2; 
0, if \n\ < 2. 

This verifies the assertions made in the introduction after (0.1). In particular, 
we see that the set of unitarily small if -types (or highest weights) is 

(f) i?^(SL(2,M)) = {//„||n|<2}. 

By contrast, the set of small if-types in the sense of [16] consists of the /Lt„ 
with \n\ < 1. 

Example 6.3. Suppose G = Sp(4, K), the real symplectic group of rank 
2. Then K = U(2) (the rank two unitary group), so T = U(l) x U(l), and 

(a) f^-Z^ CM2~z(t§)*. 
The set of roots of T'^ in g is 

(b) A(fl, t^) = {(±2, 0), (0, ±2), ±(1, 1), ±(1, -1)}; 

all but the last pair are noncompact. As a positive root in K we choose 
(1, —1) = 2pc; the dominant weights p-i^p^q) arc then parametrized by decreasing 
pairs of integers (p, q). Wc write <^(p^g) for the irreducible representation of U(2) 
of highest weight P(p,q)- Calculation of A„(//(p g^) falls into four cases according 
to the positive root system defined by /U(p,g) + ^Pc- We look at just one of these 
cases carefully. Suppose that 
(c) 

P+l>l-q>0, A+(0,f) = {(2,0), (0,-2), (1,1), (1,-1)}, 2p=(4,-2). 

Then one can calculate 

f{p-3,q + l), ifp-3>-l-g>0; 

I (p-3,0), ifp-3>0and-l-5<0; 

(d) K{I^m)-<^p^^-(^^^^ if^,-g>4andp-3<~l-g; 

[(0,0) ifp-3 < andp-g < 4. 
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Combining this information with similar calculations in the other three cases, 
we find 

(e) Bl{Sp{4, K)) = \ 3 > p > q > -3, p - q < A}. 

There are 25 representations of K in this set. The set of small representations 
of K consists of just five of them: 

(f) {S(p,g) \ l>P>q>-l, p-q<l}. 

Example 6.4. In order to understand the role of the compact part of 

the center of G, we include one example where that is nontrivial. So let G = 
U(l,l), the unitary group of the standard indefinite Hermitian form on C^. 
We can take K = T" = U(l) x U(l), and 

(a) f ~ Z2 c r2 ~ i(tg)*. 
The set of roots of T'^ in q is 

(b) A(g,t^) = {±(l,-1)}; 

these roots are noncompact. Of course this example is very close to Example 
6.2, and we use parallel notation. A calculation like the one given there shows 
that 

N /„ N _ / (P,9) - (sgn(p-^))(l,-l), iflp-g|>2; 
icj ^u{fiip,g)) |((p + g)/2,(p + ^)/2), ii\p-q\<2. 

The set of unitarily small parameters is therefore 

(d) A^(U(1, 1)) = {(m/2, m/2) | m € Z}. 

Notice that these weights are precisely the restrictions to the center of arbitrary 
weights in T"^. The unitarily small i^-types are 

(e) i?^(U(l,l)) = {5(^,,)|b-g|<2}. 

With these examples in hand, we turn to a general description of unitarily 
small K-types. In addition to the notation from the introduction, we need to 
introduce 

(6.1a) Z = identity component of the center of G. 

This group is preserved by 0, and so has a direct product decomposition 

(6.1b) z = z^Zh {z, = znK, Zh = eMioripo). 

(The subscript h stands for "hyperbolic") Write 

(6.1c) Gs = derived group of Gq, = n T". 
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On the Lie algebra level we have direct sum decompositions 
(6.1d) 00 = ds,o + 30, t§ = tsfi + 3c,o- 

(The subspaces t^^o a-i^d 3c,o correspond to what was called Vs and Vz in (1.2).) 
On the group level the corresponding decompositions are not direct: ZCiGg can 
be nontrivial. (Because we have taken Gg to be connected, the multiplication 
map from Gg x Z to G is never surjcctivc unless G is connected. In fact this 
problem persists even if we replace Gg by the full derived group of G.) 

We propose to use the decompositions in (6.1) to reduce many problems to 
the semisimple case. There is a technical complication, however: the subgroup 
Gg need not be closed in G. It is preserved by the Cartan involution, and has 
a well-behaved Cartan decomposition 

Gg = (G^nif) •exp(0,,onpo); 

but the (connected reductive) group Gg K need not be compact. When 
this happens, Gg is not in Harish-Chandra's class. Nevertheless all the results 
we have proved apply to it, after minor adjustments in the formulations. (For 
example, one considers only unitary representations oiGgCiK, and only unitary 
characters of Tg.) Alternatively, one can strengthen the hypotheses on G to 
exclude the problem. For example, one can assume that G is a finite cover 
of a real reductive algebraic group. This assumption is inherited by Gg. We 
will therefore ignore the problem, and speak as if Gg were again in Harish- 
Chandra's class. 

Lemma 6.5. With notation as above, suppose fj, G T'^ is a K -dominant 
weight. Write jiz and fig for its restrictions to Zc and Tg . Then 

MG){fi) = Xu{Gg){ng) + /i^ G itlo + i3*o- 

In particular, ji is unitarily small for G if and only if jig is unitarily small for 
Gg. 

This is obvious from the definitions. In the same way we can reduce 
matters to the various simple factors of Gg. 

Lemma 6.6. With notation as above, list the simple factors of Gg as 
GI, . . .Gl- Put Tg = TgHGl, so that there is a direct sum decomposition 

t: = (ti)* + --- + (iD*- 

Suppose jig & Tg is a {Gg fl K)-dominant weight. Write ii\ for its restriction 
toTl Then 

K{Gg){iig) = \u{Gl){iil) + ■■■ + XuiGlWg). 
In particular, jXg is unitarily small if and only if all the ii\ are. 
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Again we omit the simple proof. 
Here is the main result of this section. 

Theorem 6.7. Use the notation of Definition 6.1 and (6.1). Suppose 
S e K has highest weight /j, e T'^. Write /i^ € i^* Q for the differential of the 
restriction of n to Z^- Define Xu{fJ-) and Aa(/u) as in (0.5) and Proposition 2.3. 

Then the following conditions are equivalent. 

a) The K-type 6 is unitarily small (Definition 6.1). 

b) The parameter A„(//) is equal to Hz- 

c) The parameter Xa (/x) belongs to fj,z plus the convex hull of the Weyl group 
orbit of p. 

d) Let A'''(0,t^) be a positive root system making /i + 2pc dominant. List the 
fundamamental weights for as (cf- (1-2). Write 2pn for 
the sum of the noncompact positive roots. Then 

e) Let (A+)'(g,t'^) be any positive root system containing A+(6, t^). List the 
fundamamental weights for (A+)' as . . . , ^^'j (cf. (1.2)). Write 2p'^ for 
the sum of the noncompact positive roots. Then 

{ilp)<{i[M {i<i<i). 

f) There is a system of positive roots (A"'")'(fl, f^) containing A"'"(£, f^), with 
the property that 

l^ = l^z+ Yl (0<c^<l). 

/3e(A+)'(p,t<=) 

g) There is an expression 

li = liz+ Yl (0<6/3<l)- 

/3GA(p,t'=) 

Proof. The equivalence of (a) and (b) is clear from Lemma 6.5 and the 
definitions. For the equivalence of (b) and (c), recall from (3.1c) that \u{p) = 
Tp((Aa)(//)). Now the equivalence is clear from Proposition 1.7. 

For the rest, the conditions in (d) through (g) are clearly satisfied if and 
only if the analogous conditions on /x^ are satisfied. Lemma 6.5 therefore 
allows us to assume that G = is connected and semisimple. Under this 
assumption, we will prove that (a) implies (d); that (d) implies (e); that (e) 
implies (f); that (f) implies (g); and finally that (g) implies (a). The most 
difficult of these is (e) implies (f). 

So suppose that G is semisimple and that p, is unitarily small; that is, that 
A„(/u) = 0. According to (0.5) and Proposition 1.7, this means that p+2pc — 2p 
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belongs to — C°. Since the fundamental weights belong to the positive Weyl 
chamber C, it follows that 

(ei,// + 2pe-2/9) <0. 

Because 2p = 2pc + 2p„, this is equivalent to 
This is (d). 

Next, suppose that (d) holds. Fix (A+)' as in (e); say 
(6.2a) (A+)' = wA+, 

for some w in the Weyl group. Wc may assume that the fundamental roots 
are labelled in such a way that = w^i. Then 

(6.2b) {^[, ii) = {^i, fi + 2p,) - 2pe) = /i + 2pc) - (C.', 2pe). 

By Lemma 1.8, 

(6.2c) {wC^,fi + 2p,) < {C^,^^ + 2pc). 

By our hypothesis (d), it follows that 

(6.2d) {w^i,p. + 2pe) < {^^, 2p) = {w^i,2wp) = (^^, 2p'). 

Inserting the inequality (6. 2d) in (6.2b) yields 
(6.2e) {^i, p) < (C', 2p') - (4', 2pe) = {^l 2p'„). 

This is (e). 

Because the proof that (e) implies (f) is the most difficult part of the 
argument, we postpone it to the end. That (f) implies (g) is trivial. Assume 
therefore that (g) holds (still assuming G is semisimple); we will deduce (a). 
Choose a positive system A+ making p + 2pc dominant. The formula for p 
may then be written as 

/3eA+(p,t=) 

Here the coefficients Cjs = bp — lie between —1 and 1. We may therefore 
write 

P = 2pn+ - 1)/3; 

/3GA+(p,t<=) 

the coefficients = cp — 1 in this formula lie between and —2. It follows 
that 

p + 2pc-2p= Y Hf^ (-2<a^<0). 
^eA+(p,t) 
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Obviously the right side belongs to — C°, the cone spanned by negative roots. 
By Proposition 1.7, P(/x + 2pc - 2p) = 0; that is, A„(//) = 0. This is (a). 

Finally, wc turn to the proof that (e) implies (f). Wc proceed by induction 
on the dimension of G. Recall that we are assuming that G = Gg is semisimple. 
Lemma 6.6 actually allows us to assume that G is simple. (More precisely, if Qq 
has a nontrivial decomposition into simple factors, then the summands have 
lower dimension, so we already know the implication for them. Lemma 6.6 
allows us to deduce the implication for G.) 

Lemma 6.8. Suppose G is compact and simple. Then the only weight ji 
satisfying either condition (e) or condition (f) of Theorem 6.7 is ji = Q. 

Proof. The condition in (e) is 

(?,/^) <0 

for any fundamental weight ^ (with respect to the fixed positive system making 
/X dominant). Because fundamental weights have nonnegative inner product, 
this implies /x = 0. The argument for (f) is even simpler. □ 

We may therefore assume that G is noncompact and simple. 

Lemma 6.9. Suppose G is noncompact and simple. Then the noncom- 
pact roots span (i^)*. In particular, in the setting of Theorem 6.7(e), 

Proof. Define 

(6.3a) A° = {« G A(0, f) I {a, /3) = (/? G A(p, t))}, 

(6.3b) = roots in the integer span of A(p,t"^). 

Obviously A° and A^ are mutually orthogonal root subsystems in A. We claim 
that 

(6.3c) A = A° U A\ 

Assume this for a moment. The orthogonality of the decomposition allows us 
to conclude that root vectors for A'^ and A^ must commute with each other, 
and therefore that we get a corresponding decomposition 

(6.3d) 00 = 0^ + 00- 

Because go is simple, this decomposition must be trivial. Since G is assumed 
to be noncompact. the second factor is nontrivial; so the first must be trivial. 
Therefore A = A^, which is the first claim in the lemma. 
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To prove (6.3c), suppose 7 is any root belonging neither to nor to A^. 
Since A^ includes the noncompact roots, 7 must be compact. Since it is not 
in A'', there is a noncompact root f3 with which it has nonzero inner product. 
Possibly replacing P by —(5, we get 

(7,/3) <0. 

It follows (by the representation theory of the SU(2) generated by 7) that /9+7 
is a noncompact root. Therefore 7 = (/3+7) — /3 belongs to A^, a contradiction. 

To prove the last inequality, notice that has nonnegative inner product 
with each positive root. Therefore 

(6.3e) 

A+(p,t'') = {f5 e A(p,t) I > 0} U {certain roots orthogonal to ^'j. 

So 

(6.3f) {e^,2pn)= Yl (^^"3)- 

(e^/3)>o 

This is a sum of strictly positive terms; and it is nonempty by the first part of 
the lemma. □ 

We continue now with the proof that (e) implies (f) in Theorem 6.7. 
Recall that we are proceeding by induction on the dimension of G, and that 
we have reduced to the case when G is simple and noncompact. We propose 
to apply the inductive hypothesis to a maximal Levi subgroup of G. In order 
to construct it, we choose a positive root system (A^)'(g,t'^) D A~^(t,t'^) and 
a fundamental weight .^^ so as to maximize the quotient 

(6.4a) c, = (4',M>/(4',2p:,). 

Notice that the denominator is strictly positive by Lemma 6.9. We can make 
the numerator nonnegative by an appropriate choice of (A"^)' (for example by 
making /j, dominant); so our maximum Cj must be nonnegative. By hypothesis 
(e) of Theorem 6.7, q is bounded above by 1. Consequently 

(6.4b) < Cj < 1. 

The weight belongs to iii^)*, so by (0.6) it defines a proper Levi subgroup 

(6.4c) Li = GiCl) D 

The root system of Lj is 

(6.4d) A, = {7 G A I (e,', 7) = 0} = span of {a^ | j ^ i}. 

Our choice of positive roots for K gives a positive system 
(6.4e) A+([ine,t'=) = AinA+(e,t'=). 
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The construction of (0.6) also provides a unipotent subalgebra 

(6.4f) u, = u{^i), A(u„ t) = {7 € A I iCi, 7) > 0}. 

Recall from (0.4d) that 2p(u.j fl p) denotes the sum of the roots of in Uj fl p; 
that is, the sum of the noncompact roots having positive inner product with 
C'i- Define 

(6.4g) //i = //-2cip(ui np). 

Lemma 6.10. Use the notation o/(6.4). 

a) The weight fii belongs to the R-span of the roots of Li. 

b) The weight fii is dominant integral for Li n K . More precisely, if a is any 
root in Li fl K, then 

{a,fii) = {a,fi). 

c) The weight Hi satisfies condition (e) of Theorem 6.7 with respect to the 
group Li. 

Let us assume this lemma for a moment, and complete our proof that (e) 
implies (f). Because Lj has strictly lower dimension than G, we may assume by 
inductive hypothesis that (e) implies (f) for Lj. Parts (a) and (b) of Lemma 
6.10 guarantee that Theorem 6.7 makes sense for Li and /ij; and part (c) 
says that Theorem 6.7(e) is satisfied. By induction. Theorem 6.7(f) must be 
satisfied as well. That is, we can find a positive system (A^)" for Lj, containing 
A+([i n^,^^), so that 

(6.5a) Hi= J2 ""Pl^ (0<c;3<l). 

/3e(A+)"((inp,t=) 

Now define a positive root system for G by 

(6.5b) (A+)" = (A+)"uA(u„f). 

Then (6.4g) and (6.5a) show that 

(6.5c) 11 = 2cip{ui n p) + /Xj 

= Yl ^^^+ Yl ""P^ (0<c^<l). 
/3eA(uinp) /36(A+)"([inp,t=) 

Because of (6.4b), this expression has the form required in Theorem 6.7(f). 

It remains to prove Lemma 6.10. For (a), (1.2) shows that the R-span of 
the roots of Li is precisely the orthogonal complement of We calculate 



= (e-,M)-Q(e-,2p(uinp)). 
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Using (6.3f), we see that the second inner product on the right is just (^^, 2p^). 
Therefore 

Inserting the definition (6.4a) of we see immediately that the right side is 

zero, as desired. 

For (b), it is enough to prove the formula. In light of (6.4g), the formula 
amounts to 

(a,2p(mnp)) = (ae A([in«,t^)). 

Because the adjoint action of the reductive group Lj n if preserves Uj n p, the 
sum of the weights of the latter must be orthogonal to the roots of n K. 

We turn now to (c). Suppose therefore that (A^)" is a system of positive 
roots for Li containing A^(li n Just as in (6.5) we define a positive root 

system for G by 

(6.6a) (A+)" = (A+)"uA(u„f). 

Write 

(6.6b) W = {al...,a'(} 

for the set of simple roots, and {^J} for the dual basis of fundamental weights. 
By construction, the two positive root systems (A"*")' and (A"*")" differ by an 
element of the Weyl group of Aj. It follows that 

(6.6c) = ef. 

Furthermore the constants a defined using (A^)' and (A"*")" coincide, as do 
the weights 2p(ui np). Consequently there is no loss of generality in assuming 
henceforth that (A+)' = (A+)". 

We are trying to establish an inequality relating ^Uj and the fundamental 
weights for the positive system (A^)'. Let us write (^*)' for these fundamental 
weights. According to (1.2), they are characterized by belonging to the span 
of Aj, and by 

(6.7a) {{Cj)',ci'k)=5jH (kj^i). 

Prom these requirements we see that (^j)' must be the projection of orthog- 
onal to That is, 

(6.7b) (^y=ei-m,ei)/{^,^K 

The sum of the noncompact positive roots for Li is 

(6.7c) 2(p;j' = 2p;-2p(u,np). 

The inequality of Theorem 6.7(c) that wc arc trying to prove is 

(6.7d) ((e])',w)<((e})',2(pj,)'). 
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We begin by examining the right side. Because 2{p'!^y is a sum of roots in Li, 
it is orthogonal to So (6.7b) allows us to replace (^j)' by on the right 
side. Inserting (6.7c) gives 

(6.7e) ((Cj)', 2{piy) = {^^,2p'^ - 2p(m n p)). 

Next we examine the left side of (6.7d). By construction //j is orthogonal to 
^l, so (6.7b) allows us to replace (^p' by here as well. Just as in (6.4a), let 
us define 

(6-7f) c, = (e^,/x)/(C^,2p;). 

Using this definition and (6.4g), we get 

(6.7g) ((?i)',w) = -Q(C^,2p(u,np)) 

= Cj{C'j,2p'^) - Ci{^'J,2p{u^np)). 

Recall now that we chose i to maximize Cj. In particular we must have cj < Ci. 
Since the coefEcient of Cj on the right in (6.7g) is positive (Lemma 6.9), we 
deduce 

(6.7h) ((ej)', fii) < Ci [i^jM - i^jM^i n P))) = Ci{^j,2p'„ - 2p{Ui n p)). 

Now (6.7e) and the fact that Cj < 1 (cf. (6.4b)) show that (6.7h) implies the 
inequality (6.7d). This completes the proof of Lemma 6.10, and therefore of 
Theorem 6.7. □ 

We want next to explore some formal consequences of the characterizations 
of unitarily small ii'-types in Theorem 6.7. We will apply the following lemma 
to the set of roots of T*^ in p. 

Lemma 6.11. Use the notation of (0.3). Suppose S C «(to)* is an 
arbitrary finite subset invariant under the Weyl group of K: 

wScS {weW{K,T)). 

Define 



RiS) = {}^b,s (0 < 6, < 1) f C TO*. 

Then R{S) is convex and invariant under W{K). The following conditions on 
an irreducible representation 6 ^ K are equivalent. 

a) Every weight of 6 belongs to R{S). 

b) Every extremal weight of 5 belongs to R{S). 

c) Every highest weight of S belongs to R{S). 

d) Some highest weight of 5 belongs to R{S). 

e) Some extremal weight of S belongs to R{S). 



1108 



SUSANA A. SALAMANCA-RIBA AND DAVID A. VOGAN, JR. 



We will say that a representation of K (even reducible) is of type S if these 
conditions are satisfied. 

Proof. That R{S) is convex and W(K) invariant is obvious, as are the 
implications (a) =^ (b) ^ (c) =^ (d) ^ (e) . We will complete the proof by 
showing that (e) ^ (b) ^ (a). So assume (c) holds. The set of extremal 
weights of (5 is a single orbit of W{K), so (b) follows by the W{K) invariance 
of R{S). Now assume (b). Every weight must lie in the convex hull of the 
extremal weights. (For connected K this is a consequence of Proposition 1.7, 
and the general case follows at once.) So the convexity of R{S) shows that (b) 
implies (a). □ 

Corollary 6.12. Suppose G is a real reductive group in Harish- 
Chandra's class, and K is a maximal compact subgroup; use the notation of 
(6.1). The following conditions on an irreducible representation 6 € K are 
equivalent. 

a) The K-type S is unitarily small. 

b) The restriction 6s of 6 to Gg ri K is of type A(p,t'^) (Lemma 6.11). 

c) Write jiz € i$* q for the differential of the character of Zc on 6. Then 6 is 
of type {^JU A(p,t^). 

Proof. In light of Lemmas 6.11 and 6.5, this is a reformulation of the 
equivalence of (a) and (g) in Theorem 6.7. □ 

Before we embark on a more serious investigation of unitarily small K- 
types, we want to describe the unitarily small parameters of Definition 6.1. 
The result (Proposition 6.13) is fairly simple, but the proof is a little involved. 
We need to extend somewhat the notation introduced in (6.1). Recall that 
Qs,o = [SOjflo] is the derived algebra of go- It is a direct sum of simple ideals 
(Lemma 6.6). Write 

(6.8a) Qc,o = sum of the compact simple factors of gs,o- 

The corresponding subgroup Gc of Gs is compact, connected, and semisimple. 
Therefore it has finite center; so in particular the intersection 

(6.8b) Fc = Z{Gc) nZ (ZZc 

of its center with the identity component of the center of G must be finite. 

Proposition 6.13. Assume the setting of Definition 6.1; use also the 
notation of (6.1) and (6.8). The set AJ(G) of unitarily small parameters for 
G consists precisely of the differentials of characters of Z^jFc. 

Proof. Suppose b G B^{G) is a unitarily small representation of K. It is 
clear from conditions (f) or (g) of Theorem 6.7 that 5 must be trivial on Gc. 
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(This was essentially proved in Lemma 6.8.) The restriction of 6 to Zc therefore 
defines a character /x^ of Zc/Fc, and Lemma 6.5 shows that the corresponding 
unitarily small parameter is the differential of ^z- 

Conversely, suppose is a character of Z^/Fc. We must show how to 
extend /iz to a unitarily small representation of K. The problem is easily 
reduced to the identity component of G, so we assume henceforth that G is 
connected. Define 

(6.9a) Gn = identity component of the centralizer in G of Gc- 

Clearly this is a closed connected reductive subgroup of G. On the level of Lie 
algebras it is easy to prove a direct sum decomposition 

(6.9b) 00 = 0c,O + 0n,O- 

From this it follows that the multiplication map defines a surjective covering 
homomorphism 

(6.9c) GcxGn^ G. 

Define 

(6.9d) F = GcnGn = Z{Gc) n Z{Gn). 

This is a finite central subgroup of both factors. Its intersection with the 
identity component of the center of Gn is just the group Fc defined in (6.8b). 
The kernel of the multiplication map is 

(6.9e) Fa = {(/, /"') | / G F} C x G„. 

Now (6.9) allows us to describe the representation theory of G completely in 
terms of the representation theory of Gc and Gn separately. Here is an example. 

Lemma 6.14. Suppose G is connected] use the notation o/(6.9). The 
irreducible representations 6 of K are in one-to-one correspondence with pairs 

(5c, 5„) G Gc X {Gn^Ky, 

subject to the requirement that 

5c\f = Sn\F- 

Proof. Because of (6.9), the multiplication map defines an isomorphism 

K~(GcX (G„nif))/FA. 

The representations of the direct product Gc x (G„ fl K) are tensor products, 
and so correspond to pairs (5c, (5„). The requirement in the lemma is exactly 
what is needed to make 6c (8) 5„ trivial on Fa . □ 
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We now set out to construct a unitarily small representation of K from 
our character jiz of Zc/Fc- As a first step, consider the subgroup FZc of G„. 
Because F f\ Zc = Fc, 

(6.10a) FZ,/F ~ Z,/F,. 

So we begin by regarding jiz as a character of FZc/F. Because this is a compact 
central subgroup of G„, we can find an irreducible representation 5\ of G„nK 
such that 

(6.10b) 51\fz^ = M.. 

If 6^ were unitarily small, then C (5^ would be a unitarily small representation 
of K restricting to Hz, and we would be done. But 6^ may not be unitarily 
small, so we need to work a little harder. 

Write Tn for our fixed maximal torus in Gn H K (the intersection of T'^ 
with Gn), and /i^ G Tn for any weight of 6^. By hypothesis 

(6.10c) I^uIfz, = f^z- 

On the other hand, Gn has no compact simple factors. By Lemma 6.9, this 
implies that the noncompact roots span the semisimple part of itjj q- We may 
therefore write 



(6.10d) l^n = f^z+ b^pP (b% G 



/3eA(p,t„) 



For each noncompact root /?, choose an integer n/^ so that 

(6.10e) 6^ = 6^ + n^ G [0,1]. 

Now define /x„ G T*^ to be fi^ twisted by the sum of the various n^?/?: 

(6.10f) Mn = Ain+ J2 ""P^- 

/3eA(p,t„) 

Because the roots are characters of T„, this is well-defined. Because the center 
of Gn acts trivially on the roots, (6.10c) implies 

(6.10g) MnlFZc = l^z- 

Finally, (6.10d-f) give 

(6.ioh) ^Jin = ^^z+ (0<6/3<i). 

Now define (5„ to be the unique irreducible representation of GnflK of extremal 
weight fj,n- By Lemma 6.11, the highest weight of 6n has an expression of the 
same form as in (6.10h). By Theorem 6.7, 5„ is unitarily small. By Lemma 
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6.14, 6 = C0 6n is a unitarily small representation of K, and the restriction of 
S to Zc is fiz by (6.10g). 

7. Unitarily small K-types and the Dirac operator 

Proposition 7.1. In the setting of Definition 6.1, any irreducible repre- 
sentation of K appearing in the exterior algebra /\ p {notation (0.2)) is unitarily 
small. More precisely, the representation /\p is of type A(p,t'^) (cf. Lemma 
6.11). 

Proof. The weights of the exterior algebra of p are those of the form 

bfsP, {bp = or 1). 

/3eA(p,t<=) 

Therefore /\p is of type A(p,t). Now apply Corollary 6.12. □ 

In the theory of unitary representations, the interaction between the K- 
types of /\p and certain spinor representations plays an important role. In 
this section we will outline this theory, and show how to extend parts of it to 
all unitarily small representations. 

Our development is taken from [4, Chapter II] and [2, II. 6]. We will 
indicate particularly large departures from their conventions. We begin with 
a finite-dimensional real inner product space (Vq, ( , )). Set 

(7.1a) SO(Vo) = special orthogonal group of Vq, V = Vq (^r C. 

The Clifford algebra C(Vb) is the real associative algebra with unit generated 
by Vq and subject to the relations 

(7.1b) v'^ = -{v,v)-l {v(eVo). 

(For Chevalley this is the Clifford algebra of the form — ( , ).) Sometimes it is 
convenient to write the defining relations in the equivalent form 

(7.1c) vw + wv = —2{v,w) {v,w£Vo). 

Obviously SO(Vb) (and even the full orthogonal group 0(Vb)) acts on C{Vo) 
by algebra automorphisms. The action of —1 G 0(Vb) defines a Z/2Z-grading 

(7.1d) C{Vo) = C(Fo)cvcn + C(yo)odd. 

There is an algebra antiautomorphism transpose of C(Vo), characterized by 

(7.1e) % = -V, Xab) = *6*a {v G Vq, a,b e C{Vo)). 

(Chevalley emphasizes the antiautomorphism a that acts by +1 on Vq. It 
differs from transpose by the action of —1 G 0(Vb).) The Clifford algebra is 
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filtered by assigning the generators degree 1. Write CpiVo) for tfie p^^' level of 
the filtration. Then there is a natural isomorphism 

(7.1f) CpiVo)/Cp-iiVo)^ /\''Vo 

respecting the algebra structure and the Z/2Z-grading. It follows easily that 
there is a natural isomorphism 

(7.1g) Ci(Fo)odd ^ Vo; 

the map from right to left just sends the space Vq of generators into C{Vo). 

Write C(Vo)^ for the group of invertiblc elements of C(Vo). Because 
C(Vb) is a finite-dimensional associative algebra with a unit, C(Vb)^ is an 
open subset. It is a Lie group; the Lie algebra is C(Vb) with the commutator 
bracket. This group acts on C(Vb) by conjugation: 
(7.2a) 

Ad:C{Vo)'' ^ Aut(C(Fo)), Ad(u)(a) = uau'^ {u G C{Vo)'',ae C{Vo)). 

The differential of this representation is the action of C(Vo) on itself by bracket. 
The subgroup C(Vb)even ^'Cts in Ad to preserve the Z/2Z grading. We now 
define the spin group of Vq as 

(7.2b) Spin(\/o) = {<? G C(Fo)evcn I Ad(<7)(yo) C Vo, 'g = g-'}. 

This is the group that Chcvalley calls the reduced Clifford group Tq . The 
first condition here may also be expressed as requiring Ad{g) to preserve the 
filtration of 7.1(f). By construction, Spin(Vb) is an algebraic group, and the 
adjoint action provides an algebraic homomorphism 

r:Spin(Fo)^GL(yo). 

Because Ad preserves the algebra structure, the relation (7.1b) shows that the 
image of r is contained in 0(Vb): 

(7.2c) r:Spin(Fo) ^O(^o). 

Lemma 7.2. The image of the map r of (7.2c) is the special orthogonal 
group SO(Vo)- The kernel consists of the two scalar elements ±1 in the center 
ofC(Vo). If dim Vq > 2, this kernel is contained in the identity component of 
Spin(Vo); so in that case Spin(Vo) is a connected double cover o/SO(Vb). 

Proposition 7.3. The Clifford algebra C(Vb) is a semisimple algebra 
of dimension 2*^'°^^°. Wnte Z = Z(C(Fo)) for the center. 

Suppose that dim Vq = 2r is even. Then Z consists only of the scalars Cq. 
Consequently C(Vo) CL^d its complexification are both central simple algebras. 
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In particular, C(Vb) has a unique complex simple module {'y,S) {up to equiv- 
alence), of dimension . Regard 'y as a representation of the group C(Vb)^- 
Write a for the restriction of ^ to the subgroup Spin(Vo). Ifr>l, then a is 
the direct sum of two inequivalent irreducible representations {cr±,S±), each of 
dimension T'~^ . 

Suppose that dim Vq = 2r + 1 is odd. Then Z is two-dimensional; it is 
spanned by the scalars and an odd element z- , satisfying 

(a) {z. f = ±1 G Co. 

The subalgebra C(Vb)even has dimension 2^*" and one- dimensional center; it is 
central simple, and generated as an algebra by Spin(Vo). The entire Clifford 
algebra is a tensor product 

(b) C{Vo)^Z®^C{VoUen. 

There is a unique complex simple module (7even, -S") for C(Vb)even (up to equiv- 
alence), of dimension T" . The restriction of ^ to Spin(Vo) is an irreducible 
representation {a, S) . There are exactly two extensions 7 and 7' of 7even to a 
module for C(Vb) {on the same space S); they are related by 

(c) 7(^) = -l'{v) {v e Vo). 

Any complex simple module for C(Vo) is isomorphic to exactly one of 7 
and 7' . 

In either case, suppose {^,3) is a simple module for C{Vo). Then there 
is a positive definite invariant Hermitian form { , ) on S. This means that 
7(a)* = 7(*a), or explicitly that 

(d) {^{a)s,s') = {s,^{^s'). 

This form is unique up to a positive scalar multiple. In particular, the repre- 
sentation {(T,S) o/Spin(Vb) is unitary. 

We should make two remarks about the notation introduced in this propo- 
sition. There is no preferred choice between the two irreducible constituents 
of the spin representation in the even-dimensional case; to call one of them cr+ 
is to make a choice. Similarly, there is no preferred extension of 7even in the 
odd-dimensional case; calling one 7 is making a choice. 

This proposition summarizes several results in Chapter 2 of [4]. (The 
formulation in II.6.2 of [2] is not quite correct in the odd-dimensional case, 
when it overlooks the nonuniqueness of the extension of 7even 

to C(Fo)-) 

Definition 7.4. Suppose we are in the setting 7.1-7.2. A space of spinors 
for Vo is a complex simple module (7,5') for the Clifford algebra C(Vo), en- 
dowed with a positive definite invariant Hermitian form ( , ), as described in 
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Proposition 7.3. We write {a, S) for the corresponding unitary representation 
of Spin(Vo); we will sometimes call a a spin representation. By 7.2(a) and the 
definition of a, 

7(Ad(5)(a)) = a{gMa)a{g-') {g G Spin(yo), a G C(Vb))- 

Example 7.5. Suppose Vq is a one-dimensional space Rt^O) ^-nd that vq has 
length one. Then SO(Vb) is trivial. The Clifford algebra C(Vb) is generated 
by vo with the relation Vq = —1; that is, C(Vb) is isomorphic to the algebra C 
of complex numbers. There are two possible isomorphisms, sending vq to i or 
to —i. The even subalgebra is 

C(Vb)even = M C C, 

and the odd subspace is iR. The transpose automorphism is complex conjuga- 
tion, so we see that 

Spin(Vb) =±1 CM''. 

The unique complex simple module for C(Vo)cvcn is just C; the two possible 
extensions to C(Vo) have vq acting by ±1 (The distinction between these is 
not just a matter of choosing i G C; we must also choose between vq and —vq 
as a basis element of Vq.) 

Example 7.6. Suppose Vq is two-dimensional, with an orthonormal basis 
{j, k}. Then SO(Vb) consists of the 2x2 matrices 

(a) soiVo) = Ue)=h'l 

\ sm fc* cos fc* 

The Clifford algebra has basis {l,j,k,jk}, with relations 

(b) f = k^ = -l, jk = -kj. 
This is evidently isomorphic to the algebra of quaternions 

(c) m = {a + bi + cj + dk} 

by sending jk to i. The transpose antiautomorphism is the usual conjugation 
of quaternions (which is —1 on i, j, and k). The even subalgebra is 

(d) C(Fo)even = C C H. 

It is not difficult to check from (d) and the definition (7.2b) that 

(e) Spin(Vb) = {s(0) = cos (/> i sin | G M} . 
The conjugation action on Vq is 

(f) r(s(0)) = r(20). 
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To see that, one calculates for example 

= (cos(p + isin(p)j{cos4i — isincp) 

= j cos^ (j) — iji sin^ (p + {ij — ji) sin cos 4> 

= j(cos^ 4> — sin^ (f>) + k{2 sin cp cos (p) 

= j cos 2(p + k sin 20 

= r-(20)j. 

Therefore Spin(Vb) is the double cover of the circle SO(Vo)- The unique com- 
plex simple module for C(Vb) may be realized on S = by 

The natural decomposition = C + C gives a Spin(Vo)-invariant decompo- 
sition S = S-\. + Combining (e) with the third formula in (g), we see 

that 

(h) cr±ir{(p)) = cxp(±7;0). 

That is, the two half-spin representations a± are the first two characters of the 
circle Spin(Vb). 

One reason for considering these two examples in such detail is that many 
aspects of general Clifford algebras and spin representations can be reduced to 
dimensions one and two. In order to understand how, we need a little more 
notation. 

Suppose first that Wq C Vq is any subspace. We immediately get a natural 
map of Clifford algebras 

(7.3a) C{Wo) ^ C{Vo) 

respecting Z/2Z gradings, filtrations, and the transpose. By (7. If) this map is 
one-to-one; we use it to identify C{Wo) as a subalgebra of C(Vo). It is clear 
from the definition in 7.2 that (7.3a) induces an inclusion of groups 

(7.3b) Spin(VFo) ^ Spin(yo). 

Suppose now that C/q is a second subspace of Vq, and that 
(7.3c) Uq is orthogonal to Wq. 

Then (7.1c) says that 

(7.3d) wu + uw = {ueUo, w e Wo). 

From this we can get complete commutation or anticommutation rules for even 
and odd elements of C{Uq) and C{Vq); but we will be content with 

(7.3e) ab-ba = (a G C(I^o)even, b G C{Uo)). 
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In particular, 

(7.3f) Spin(VFo) and Spm([/o) commute. 

The isomorphism (7. If) also shows that C{Wo) and C{Uo) meet only in their 
common scalars. Lemma 7.2 therefore shows that 

(7.3g) Spin(VFo) n Spin(C/o) = {±1}, 

Spin(VFo) X|±i} Spin([/o) ^ Spin(Fo). 

Here the notation means that we divide the product group by the diagonal 
copy of {±1}. 

The formula (7.3f ) suggests that an orthogonal decomposition of Vq ought 
to give rise to a tensor product decomposition of the Clifford algebra. This 
is complicated by the strange shape of the commutation relation (7.3d). The 
following bit of extra structure will allow us to circumvent this. 

Definition 7.7. Suppose wc arc in the setting 7.1-7.2, and that dimVo is 
even. A special element e G Spin(Vo) is one satisfying 

r(e) = -1 G SO(yo). 

Such an element exists and is unique up to sign by Lemma 7.2. Because 
r(e^) = 1, we must have = ±1. In Example 7.6, e = s(7r/2) = i is a special 
element of square —1. If Vq = 0, then e = ±1 are special elements of square 1. 
It turns out that = (—1)'' when dimVb = 2r, but we will not need this. 

Proposition 7.8 ([4, 11.2.5]). In the setting 7.1-7.2, suppose that there 
is an orthogonal decomposition 

(a) Vo = Wo + Uo, 

and that dim Wq is even. Choose a special elements G Spin(Wo) C C'(W^o)even- 
Suppose first that = 1. Then there is an isomorphism of algebras 

(b) m: CiWo) (8)M C([/o) ^ C(Vb), 
defined by 

( ab, ifae C(Wo) and b G C(C/o)even; 
\ aeb, if a E C(Wo) and b G C(?7o)odd- 

This isomorphism complexifies to 

(d) jc: CiWo)c ®c C(C/o)c ^ C(Vb)c. 

Suppose next that = —1. Then there is an isomorphism of complexified 
algebras as in (d), given by 



(c) M{a(S)b) 



(e) jcia0b) 



( ab, ifae C(Wo)c and b G C(C/o)c,even; 
\ iaeb, if a e C{Wo)c and b G C(C/o)c,odd- 
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Suppose (7(VFo), S'(VFo)) and ('y{Uo), S(Uo)) are complex simple modules 
forC{Wo) andC{Uo) (Proposition 7.3). Then 

(f) S = S{Wo) S{Uo) 

is a simple module for C(Vb) under the isomorphism jc of (d). In this way 
the restriction of the spin representation (T(Vb) of Spin(Vb) to the subgroup 
Spin(Wo)Spin(i7o) (Def. 7.4 and (7.3g)) is identified with the tensor product of 
the spin representations of the factors: 

(g) o-(Vb)|spin(Wo)Spin(C7o) - cr{Wo) cr{Uo). 

Corollary 7.9. In the setting 7.1-7.2, suppose dimVb = 2r + 5, with 5 
equal to or 1. Choose a collection of r orthogonal two-dimensional subspaces 
Wi,...,Wr of Vq. Recall from Example 7.6 that each group Spin(Wi) is a 
double cover of the circle group SO(Wi), with two-element kernel ztlj: 

1 ^ {±10 ^ Spin(Wi) ^ SO{Wi) ^ 1. 

Write 

T{Wi, ...,Wr) = SO(PFi) X • • • X SO{Wr), 

f{Wi, ...,Wr) = Spin(VFi) X{±i} • • • X{±i} Spin(W,). 

Here the second definition means the quotient of the direct product by the sub- 
group generated by all elements (— lj)(— Ij) (1 < i,j < r). This is a double 
cover of the corresponding product of orthogonal groups: 

1 ^ {±1} ^ f{Wi, ...,Wr)^ T{Wi, ...,Wr)^l. 

a) The group T{Wi, . . . , Wr) is a maximal torus in SO(Vb). 

b) The group T(Wi, . . . ,Wr) may be naturally identified as a subgroup of 
Spin(Vo); it is a maximal torus. 

c) Write ±/3j for the two weights o/SO(l^i) on (Wi)c', extend them to all of 
T{Wi, . . . , Wr) by making them trivial on the other factors SO{Wj). Then 
the weights of T{Wi, . . . , Wr) on (Vo)c are . . . , i/3r}) together with 
if 5 = 1. 

d) The weights of the spin representation a{Vo) o/Spin(Vb) o-re the 2'' weights 
{l/2(±/3i±---±/3,)}. 

Corollary 7.10 ([2, Lemma II. 6. 5]). In the setting 7.1-7.2, choose a 
spin representation {a,S) (Def. 7.4). Then the tensor product representation 
a® (J o/Spin(Vo) descends to SO(Vo) by the map of {7.2c). As representations 
of SO{Vo), 

a ® (T if dim Vq is even; 

a ® a -\- a ® a if dim Vq is odd. 
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Finally we introduce the Dirac operator. In the setting (0.2), recall that 
our fixed bilinear form ( , ) is positive definite on po- We will make the 
constructions based on 7.1-7.2 with po playing the role of Vq. The adjoint 
action of K on po preserves the form, and so defines a homomorphism 

(7.4a) Ad:ir^O(po). 

Of course the identity component Kq is mapped to SO(po). Recall from (7.2c) 
and Lemma 7.2 that we also have a spin double cover of SO(po)- This covering 
pulls back by Ad to a double cover of Kq. More precisely, we define 

(7.4b) Ko = {{k,g) eKoX Spin(po) | Ad(A;) = T{g)}. 

Then projection on the first factor defines a short exact sequence 

(7.4c) 1 {±1} ^ ^0 ^ -F^o ^ 1- 

Similarly, projection on the second factor defines a homomorphism 

(7.4d) Ad:i^o^Spin(po). 

Fix now a space of spinors (7, S) for po (Definition 7.4). By composition with 
Ad, the spin representation defines a representation 

(7.4e) {a o Ad, S) 

of Kq on S. We call this the spin representation of Kq, and often denote it 
simply a. 

Suppose now that X is a (g, i^)-module. Often we can understand very 
well the action of K on X, in terms of the Cartan-Weyl theory of finite- 
dimensional representations. What remains, therefore, is to understand the 

action of po on X. The Dirac operator provides a way to compare this action 
with the action of po on S by Clifford multiplication. Because the latter action 
is also well understood, the problem of understanding X is to some extent 
reduced to understanding the Dirac operator. 

Definition 7.11. Suppose G is a reductive group as in (0.2). Use the 
notation of (7.4), so that in particular we have chosen a space (7, S) of spinors 
for po- Suppose that (vr, X) is a representation of q. The Dirac operator for X 
is an endomorphism D of X (g) S, defined as follows. Let {Yi} be a basis of po, 
and {Y^} the dual basis: 

(a) {Yi,Y^) = Sij. 
Then the Dirac operator on X 5 is 

(b) L> = J]7r(y,)®7(n- 
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The construction of a Dirac operator therefore requires a choice of a space 
of spinors. We saw in Proposition 7.3 that if po is odd-dimensional, there are 
two inequivalcnt choices for such a space. It is natural to ask how changing the 
choice affects the Dirac operator. Proposition 7.3 shows that the two choices 
7 and 7' may be realized on a common space S, and that they are related by 
7(y) = -'j'(Y) (for y e Po)- The two Dirac operators D and i:)' on X (8> 5 are 
then related hy D = —D'. We will be interested mostly in the eigenvalues of 
D^; they are of course unaffected by such a change. 

PROPOSITION 7.12 (Parthasarathy [14, Lemma 2.5]; see also [13, 
Prop. 3.1], and [2, Lemma II. 6. 11]). 

a) In the setting of Definition 7.11, the operator D is independent of the 
choice of basis {Yi}. 

b) Write flo for the Casimir operator of G, and Q.k for the Casimir operator 
ofK ([8, p. 209). Then 

^2 ^ -T^iytc) 1 + (vr ® a){nK) - Hp, p) - {pc, Pc))- 

Here pc is as defined in (0.4e), and p is half the sum of any set of positive 
roots for g. 

c) Suppose that X is a Hermitian representation of Qq . Then D is formally 
self-adjoint with respect to the tensor product Hermitian structure on X 

{Dx,y) = {x,Dy) {x,yeX(g)S). 

d) Suppose X is a {q, K)-module. Then X 1^ S is a locally finite represen- 
tation of Kq for the tensor product action tt ® a. The Dirac operator D 
intertwines this action. 

e) Suppose X is a unitary (g, K)-module, and that tt{Qg) is a scalar operator. 
Then D'^ has nonnegative eigenvalues onX^S. In particular, suppose that 
X has an infinitesimal character corresponding by the Harish- Chandra 
parametrization to a weight (piX) G f)*. Let p, G (f^)* be the highest weight 
of any representation of Kq on X ® S. Then 

(p + Pc^p + Pc) > {4>ix),4>ix)). 

Proof. Part (a) is entirely elementary; the argument is omitted in any of 
the references mentioned. A version of (b) (essentially for X equal to C°°{G)) 
is proved in [13]; the observation that Parthasarathy 's argument applies in the 
present setting appears in all the other references. For part (c), the Hermitian 
property of tt means that the operators Tr{Yi) are skew-adjoint. By (7.1e) and 
(7.3d), the Clifford multiplication operators 7(y*) are skew-adjoint. By (b) of 
Definition 7.11, the Dirac operator D is self-adjoint. 
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For (d), the first assertion is trivial. For the second, suppose k G Kq; 
write k e Kq for its image by (7.4c). Then 

(7.5a) (w{k) ® a(fc)) D (jrik-^) ^ a{k-^)^ = ^ Tr{Ad{k)Yi) ® 7(Ad(A:)y^). 

i 

Here we have used for tt the compatibiUty of the group and Lie algebra repre- 
sentations, and for 7 the condition in Definition 7.4. Because {Ad{k)Yi} is a 
basis of po and {Ad(A;)y*} is the dual basis (by the ii'-invariance of our bilinear 
form), it follows from (a) that the right side of (7.5a) is D, proving (d). 

For (e), part (b) shows that is diagonalizable. If x is a nonzero eigen- 
vector of eigenvalue c, then it follows from (c) that 

(7.5b) c= {Dx,Dx)/{x,x). 

Because the form on X is positive, the form on X (g) 5 is positive as well; so the 
denominator in (7.5b) is positive and the numerator nonnegative. Therefore 
c > 0, as wc wished to show. For the last inequality, the eigenvalues of are 
computed by (b). Under the assumptions in (e), we find first of all that 

(7.5c) 7rinG) = {HX),HX))-{p,p). 

(This standard formula is proved for example in [7, Ex. 4, p. 134].) Let 5 be a 
representation of Kq of highest weight Ji; then for the same reason we have 

(7.5d) S{nK) = {Jl + Pc,Ji + Pc) - {Pc, Pc)- 

Suppose now that x G X (g) 5 transforms according to the representation S. 
Then the formulas in (b) and (7.5c) and (7.5d) show that x is an eigenvector 
for D^. The eigenvalue c is equal to 

(7.5e) 

- {P,P)) + {{V' + PcJi + Pc) - (PcPc)) - {{p,p) - {pcPc)) 
= {ll + Pc,ll + Pc) - {(piX), (t>{X)). 

The nonnegativity of c is therefore the last inequality in (e). □ 

The inequality in Proposition 7.12(e) is sufficiently important that we 
state it separately, in a slightly strengthened form. 

Proposition 7.13 (Parthasarathy's Dirac operator inequality; see [14, 
Lemma 2.5]). Suppose G is a reductive group as in (0.2), and X is an irre- 
ducible Hermitian {g, K) -module. Suppose that X has infinitesimal character 
corresponding by the Harish- Chandra parametrization to a weight 4>{X) G f)*. 
Recall from Definition 5.6 the canonical real part RE^(X) G iiQ-\- a^. Fix a 
space S of spinors for po ; cmd let p, be the highest weight of a representation S 
of Kq occurring in X S. 
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List the representations of Kq occurring in 5 ®a as {Si, . . . ,Sr}- Assume 

that 

the Hermitian form on X is positive on the K^-types 6i. 
{This is automatic if X is unitary.) Then 

ill + Pc,Ti + Pc) > (RE <P{X),RE <t>{X)). 

The improvement over the inequahty in Proposition 7.12(e) takes two 
forms. First, the positivity of the Hermitian form on X is assumed only on a 
specific finite set of Ko-types, and not on the entire representation. Second, 
we have replaced (/>(X) by its canonical real part. To see that this is an im- 
provement, write (t>{X) = RE^(X) + ilM^(X). Then the squared length of 
(t){X) is 

(7.6a) (RE (^(X), RE 4){X)) - (IM (^(X), IM (^(X)) + 2?(RE (/)(X), IM (^(X)). 

The inner product is real and positive definite on the image of RE and IM; 
so the first term here is positive, the second negative, and the third purely 
imaginary. On a Hermitian representation the Casimir operator must have a 
real eigenvalue, so the third term is zero; and we get 

(7.6b) (</-(X), </>(X)) < (RE <^(X), RE (t>{X)). 

This says that the inequality in Proposition 7.13 implies the one in Proposition 
7.12(e). 

Proof. Write Xq for the KQ-hwaxisxA subspace of X generated by the iso- 
typic subspaccs of type 5i. Suppose x ^ X®S is a nonzero vector transforming 
according to the representation 5. Then it follows from the definition of {5i} 
that X ^ Xq® S. By Proposition 7.12(d), Dx also transforms according to 
5, so Dx G Xq (g) S. By hypothesis, our Hermitian form is positive definite on 
Xq (g) S\ so 

(7.7a) {Dx,Dx)/{x,x) >0. 

Now the same calculation as in (7.5b) and (7.5e) shows that 

(7.7b) iJl + pc,jl + Pc) > iHX), 0(X)). 

To get the canonical real part into the picture, we use Theorem 16.10 in [8]. 
The result is of sufficient interest to state separately. 

PROPOSITION 7.14 ([8, Th. 1 6.10]). Suppose G is a real reductive group 
in Harish- Chandra's class, and {X,{ , )) is an irreducible Hermitian {q,K)- 

module. Suppose H is a 0-stahle Cartan subgroup of G, and that the infinitesi- 
mal character of X is given in the Harish- Chandra parametrization by a weight 
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(piX) G [)*. Then there exist a parabolic subgroup Pi = MiAiNi of G, an irre- 
ducible Hermitian Harish- Chandra module Xi for Mi, and a unitary character 
vi G ial g, with the following three properties. 

a) The infinitesimal character of Xi has a Harish- Chandra parameter that is 
conjugate by Ad(g) to RE(/)(X). 

b) The weight vi is conjugate by Ad(g) to ilM(p{X). 

c) There is an isomorphism of Hermitian representations 

Consider the Hermitian representation 

X' = Ind&^^^^^(Xi(8) 1(8)1); 

this is a {g, K) -module of finite length. 

d) The representations X and X' are isomorphic as Hermitian represen- 
tations of K. In particular, their signature characters coincide (Defini- 
tion 5.3). 

e) The infinitesimal character of X' is just that of Xi ® 1 composed with 
a Harish- Chandra homomorphism, and is therefore given in the Harish- 
Chandra parametrization by the weight 

(^(X') = RE(^(X). 

Proof. Parts (a)-(c) are essentially proved in [8, Th. 16.10]. Part (d) fol- 
lows immediately from the construction of the Hermitian form on a paraboli- 
cally induced representation in the "compact picture." Part (e) is a standard 
calculation of infinitesimal characters of induced representations ([8, Prop. 
8.22]). □ 

Returning to the proof of Proposition 7.12, we now apply Proposition 7.12 

to the representation X. By (d), the representation X' inherits the positivity 
assumption made on the K -types of X. We may also identify the clement x 
with an element of X' S, still transforming by 6. Applying the inequality 
(7.7b) to the representation X' therefore gives the conclusion we want. 

Now we will relate these ideas to the notion of unitarily small types. 
Here is a classical fact that hints at what we want. 

Proposition 7.15. Suppose G is a connected reductive group as in 
(0.2), and (cr, 5) is a spin representation for po {a representation of Kg; see 
(7.4)). Supposed is a finite- dimensional irreducible representation of K . Then 
the following conditions on 6 are equivalent. 

a) The representation 6 occurs in /\p. 
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b) There is an irreducible constituent ai of a so that (5®cri contains a Ko-type 
in S. 

c) There are irreducible constituents u\ and o"2 o/cr so that S occurs in (7i(8)o"2. 

This is an easy consequence of Corollary 7.10; we omit the argument. By 
Proposition 7.1, a representation 5 satisfying these conditions is unitarily small. 
What wc want to do is weaken the conditions until they arc precisely equivalent 
to unitarily small. We begin with some properties of the spin representation. 

Lemma 7.16 ([2, Lemma II. 6. 9]). Suppose G is a connected reductive 
group as in (0.2), and {o;S) is a spin representation for po (a representation 
ofKo; see (7.4)). 

a) The representation a is of type ^A{p,t'^) (Lemma 6.11). That is, every 
weight of a is a sum of noncompact roots with coefficients between —1/2 
and 1/2. 

b) Suppose A"'"(g,t'^) is a system of positive roots containing A"'"(6, f^). Then 

Pn = 1/2 Yl 

is a highest weight of a. Similarly —pn is a lowest weight of a. 

c) Every highest weight of a is of the form in (b) . 

Proposition 7.17. Suppose G is a semisimple group as in (0.2), and 
{a, S) is a spin representation for po . Suppose 6 is an irreducible representation 
of K. In the notation of Definition 6.1, the following conditions on 5 are 
equivalent. 

a) The representation 5 is unitarily small. 

b) There is an irreducible constituent ai of a and an irreducible constituent 
(72 of 6 ® ai so that a2 is of type ^A(p,tc) {Lemma 6.11). That is, every 
weight of a-i is a sum of noncompact roots with coefficients between —1/2 
and 1/2. 

c) There is an irreducible constituent o"i of a and an irreducible representa- 
tion (72 of type ^A(p, tc), with the property that 6\ko contains an irreducible 
constituent of (7i (72 . 

d) There are irreducible representations a\ and of Kq, of type |A(p,tc), 
with the property that S\ko contains an irreducible constituent of ai (8) (72. 

Proof. We will prove that (a)=^(b)^(c)=^(d)=^(a). So suppose (a) holds. 
Let p G i(to)* be a highest weight of 5. By Theorem 6.7(f), we can find a 
positive root system A"'"(0, t^) so that 

Yl (0<C;3<1). 

/3eA+(p,t'=) 
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Write 60 for an irreducible constituent of 6 (as a representation of Kq) of 
highest weight /it, and cri for an irreducible constituent of a of lowest weight 
—pn (Lemma 7.16(b)). By a theorem of Parthasarathy, Rao, and Varadarajan 
([12, Cor. 1 to Th. 2.1]), there is an irreducible constituent C72 of do (Ti of 
extremal weight 

P-Pn= Yl (c/3-V2)/3 (-1/2 <c^- 1/2 < 1/2). 
/3eA+(p,tc) 

By Lemma 6.11, o"2 is of type ^A(p,tc). This is (b). The implication (b)=^(c) 
is formal from the self-duality of S. That (c)=^(d) is a formal consequence of 
Lemma 7.16(a). Finally, assume (d). The weights of cJi (g)cT2 are all of the form 
71 + 72, with 7j a weight of CTj. It follows immediately that ai (8) ct2 is of type 
A(p,ic). Now (a) follows from Theorem 6.7(g). □ 

We can now prove a result in the direction of Conjecture 5.7; more pre- 
cisely, of Conjecture 5.7'. 

Proposition 7.18. Suppose G is a semisimple group, and suppose 
X G n5^(G) is an irreducible Hermitian (q, K)-module (Definition 5.1). Let i) 
be a 9 -stable Cartan subalgebra of Q, and G f)* a weight parametrizing the 
infinitesimal character of X. Assume that 

{REcj>,REcj)) > {p,p). 

Then the Hermitian form on X must be indefinite on K -types in B^{G). 

Proof. Suppose not. Then we may assume that the form is positive def- 
inite on the K-types in B^{G). By hypothesis X contains a unitarily small 
i^T-type S G B^{G). By Proposition 7.17, we can find a representation c72 of 
type iA(p,t'^) occurring in 5 (g) cr, and therefore in X (g) 5. We are going to 
apply Proposition 7.12. We therefore list the representations of K containing 
constituents of (T2 c as {5i, . . . ,6,.}- By Proposition 7.17(d), these are all 
unitarily small; so by hypothesis the Hermitian form on X is positive on them. 
Write iJ,2 for the highest weight of a2- According to Proposition 7.12, 

(7.8a) {p2 + Pc,fi2 + Pc) > (RE (j), RE </>) . 

Fix a positive root system A"'"(0, f^) containing A+(t, f^), and write pn for half 
the sum of the corresponding noncompact positive roots. Because a"2 is of type 



CLASSIFICATION OF UNITARY REPRESENTATIONS 



1125 



^A(p,t'^), we can write 

(7.8b) /X2= Yl ic(3-c-p)l3 (0<c±^<l/2) 

/3eA+(p,t<=) 

= Yl ""f^f^ {-l/2<a0<l/2) 

= Pn- Yl (0<6^<1). 

/3eA+(p,t=) 

Adding pc gives 

(7.8c) Ii2 + Pc = p- Y iO<bp<l). 

By Proposition 1.10, it follows that /X2 + Pc belongs to the convex hull of the 
Weyl group orbit of p. Consequently 

(7.8d) {n2 + Pc, M2 + Pc) < {p, p)- 

Combining this with (7.8a) gives (p, p) > (RE ^, RE <;!!)) , contradicting the hy- 
pothesis in the proposition. This contradiction completes the proof. □ 

This argument seems to us to be rather natural and powerful; so it is 

disappointing that wc cannot deduce Conjecture 5.7' from it. Perhaps the 
problem lies in Proposition 7.13. The following sharpening of that proposition 
would (by the argument above) immediately imply Conjecture 5.7'. 

Conjecture 7.13. Suppose we are in the setting of Proposition 7.13; make 
the same hypotheses as for that proposition. Then RE0(X) is conjugate by 
Ad(0) to a weight in the convex hull of the Weyl group orbit of p + pc- 

We are being a little bit vague about the Weyl group in this conjecture; 
probably it is enough to use the Weyl group W{Q^i^) of the restricted root 
system, but the conjecture would still imply Conjecture 5.7' even if we take 
the full Weyl group W{q, \)'^). 



8. Topology of the unitary dual 



In this section we consider the relationship between the parametrization of 
the unitary dual given (conjecturally) by Theorem 5.8 and the Fell topology. A 
careful treatment of this topic would require a careful foundational discussion 
of the Fell topology, which we prefer to avoid. Our arguments will therefore 
be sketchy at several crucial points. 

We begin with a discussion of infinitesimal characters. Fix a ^-stable 
positive root system A+(g,f)'^) for the Cartan subalgebra f)*^ of (0.4a); this 
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choice is equivalent to the choice of a system A+(g,t'^) of positive restricted 
roots. We may assume that A+(g,t'^) contains our fixed system A+(€,t'^) of 
positive roots for t. 

Definition 8.1. With notation as above, suppose G (^'^)* is a weight. 
We say that 4> is complex dominant if it satisfies either of the following equiv- 
alent conditions. 

a) The canonical real part RE<^ (Definition 5.6) is dominant for A~^{q,1}'^); 
and the canonical imaginary part IM (p is dominant for those positive roots 
orthogonal to RE (j). 

b) For every positive root a € A~^{Q,t)^), we have either Re(^, a) > 0; or 
Re {(p, a) = 0, and Im {(j), a) > 0; or {(j), a) = 0. 

The set of complex dominant weights is denoted 

Cc(A+(fl,r))c({,T. 
It is a fundamental domain for the action of W{q, t)'^) on (f)"^)*: 

Cc(A+(s,r))^(r)*Wfl,r)- 

We endow Cc(A+(g, f)*^)) with the quotient topology from this bijection (and 
not with the subspace topology from f)"^, which has more neighborhoods of 
purely imaginary elements). 

The ordinary positive Weyl chamber CR(A"'"(g, f)"^)) consisting of dominant 
elements of (itg + a^)* is a subset of Cc(A+(g, f)"^)). We will use the fact that 
the topology on Cr coming from this inclusion (that, is the quotient topology 
from 

CM(A+(0,f)-))^(ite + a^)7W^(0,{)^) 
coincides with the subspace topology from the inclusion 

CM(A+(0,Oc(rtUaSr- 

We now write 
(8.1a) 3(5) = center of U{g). 

The Harish- Chandra isomorphism is 
(8.1b) ^ Sm^^^'^^\ 

An infinitesimal character is by definition a homomorphism from 3(s) to the 
complex numbers, or equivalently a maximal ideal in 3(0)- By analogy with 
the notation we are using for representations, the set of infinitesimal characters 
is written 



(8.1c) 



n(3(0)) = Max 3(0). 
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The isomorphism (8.1b) identifies these infinitesimal characters with W orbits 
on [)*: 

(8.1d) n(3(0)) ^ m*/WiQ, r) ^ Cc(A+(0, [)^)); 

the last equivalence comes from Definition 8.1. We will describe this map a 
little more carefully in (8.2) below. 

The set of infinitesimal characters carries a "Fell topology" of its own: the 
weakest topology making each of the evaluation maps 

(8.2a) e,: n(3(g)) ^ C, e,(x) = x{z) {z G 3(g)) 

continuous. (We use the usual analytic topology on C; if instead we used 
the Zariski topology, we would get the restriction to Max 3(b) of the Zariski 
topology on Spcc3(0).) We can restate the definition of the topology as follows. 
A set [/ C n(3(0)) is a neighborhood of the element xo ^ U if and only if 
there are elements zi, . . . , Zn & 'dis) and positive numbers £i, . . . , e„ with the 
property that U contains 

(8.2b) iV(z,£;xo) = {xen(3(0)) I |x(zi)-Xo(^i)| <£i (z = l,...,n)}. 

Now Chevalley's theorem says that 3(g) is isomorphic to a polynomial ring 
C[xi, . . . , x„i]- (The elements xi, . . . , Xm may be thought of as generators of 
3(0); by the Harish-Chandra isomorphism (8.1b), they correspond to genera- 
tors for the algebra of VF-invariants in S'(f)'^).) Each element ^ = (^1, . . . , ^m) G 
C"* defines an element € n(3(g)); the characteristic property is x^i^i) = Ci- 
By the Nullstellensatz, this correspondence gives an isomorphism 

(8.2c) n(3(g)) 

It is very easy to check (by the description of neighborhoods in (8.2b)) that this 
isomorphism sends the topology on n(3(g)) to the standard topology on C"^. 
We want to know something slightly more subtle, however. We may identify 
S{i)'^) with the algebra of polynomial functions on (f)*^)*. Each A G (f)'^)* 
therefore defines an algebra homomorphism 

(8.2d) ^^:5([)'=)^C, p^p{X). 

We use the same symbol to denote the composition with the Harish-Chandra 
homomorphism: 

(8.2c) ^^:3(g)^C. 
In this way we get a map 

(8.2f) (f)T^n(3(g)), A^^A- 

This is the map of (8. Id): it is surjective, and the fibers are precisely the orbits 
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It is more or less obvious from the definitions that the map of (8.2f) 
is continuous (from the standard topology on (t)'^)* to the "Fell topology" 
on n(3(0))). What we need is the stronger assertion that the topology on 
11(3(0)) is actually the quotient topology; equivalently, that the map (8.2f) is 
open. Here is an explicit formulation. 

Lemma 8.2. In the setting of (8.2), suppose {pi, . . . ,Pm) is a collection 
of generators for S'(f)'^)^(0'''°\ Fix Aq € (f)'^)* and £ > 0. Then there is a 
positive number S so that if X & {^'^)* and 

\Pi{X) - pi{\o)\ < 6 (i = l,...,m), 

then there is a w € W{g, f)'^) such that 

|A — li; ■ Ao| < s. 

In the case of GL(n), this lemma in turn can be reformulated as follows. 
Suppose /o is a monic polynomial of degree n with roots (Ao,...,Ao), and 
£ > 0. Then there is a (5 > so that if / is a monic polynomial whose 
coefficients are within 6 of those of /o, then the roots (A^,...,A") of / are 
each (after permutation) within e of the corresponding roots of /q. That is, 
it says that the collection of roots of a polynomial depends continuously on 
the coefficients. This is of course well known. In keeping with the incomplete 
nature of this section, we omit the argument for the general case. 

Corollary 8.3. The bijection of (8. Id) is a homeomorphism from the 
^^Fell topolog'tf to the quotient topology from (f)'^)*. 

Definition 8.3. The infinitesimal character map 

n„(G) ^ n(3(0)), TT^CW 

sends an irreducible unitary representation tt to the homomorphism ^(vr) by 
which 3(fl) acts on the space of smooth vectors of tt. 

Theorem 8.5 (Bernat-Dixmier [1]). The infinitesimal character map 
is continuous from the Fell topology on the unitary dual to the ^^Fell topologi/^ 
on n(3(0)) (cf. (8.2)). 

Corollary 8.6. The map 

n„(G) ^ Cc(A+), 7r^(/.(7r;A+) 

{obtained by composing the infinitesimal character map of Theorem 8.5 with 
the isomorphisms 0/(8. Id)) is continuous from the Fell topology on the unitary 
dual to the quotient topology (Definition 8.1) on the cone of complex dominant 
weights. 
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This is immediate from Theorem 8.5 and Corollary 8.3. 

We are now in a position to draw some conclusions about the topology of 
the unitary dual. A little more notation is helpful. In the setting of Definition 
8.1, suppose A € i(to)*. Define D/^+{X) to be the unique VF(0,t'^) conjugate 
of A belonging to the positive Weyl chamber C of (0.5c). (Notice that C is 
contained in Cr(A"'").) The map 

(8.3a) i{i^y^C, X^D^+{X) 

is continuous and finite-to-one. On the other hand, the canonical real part 
(Definition 5.6) defines a continuous map 

(8.3b) ((,-)* ^i(ig)* + (ag)*, 0^RE</.. 

This map is VF-equivariant, and therefore descends to a continuous map for 
the quotient topologies 

(8.3c) Cc(A+) ^ Cr(A+), cP^REcp. 

Similarly, the map Tp of Proposition 1.4 is continuous: 

(8.3d) z(t§)* + (a§)* - ^(t[j)* + (a^)*, <t> ^ T,(0). 

To see this, recall that Tp is defined separately on each closed Weyl chamber 
C: if p' is half the sum of the positive roots for C, and P' is the projection 
on C (Definition 1.2), then 

(8.3e) Tp{<j)) = P'{<p-p'). 

This mapping is obviously continuous on C, because P' is a contraction. Since 
C is closed, and the definitions agree on the intersections of different chambers 
(Proposition 1.4), Tp is continous. 

Theorem 8.6. In the setting of Definition 8.1, suppose tt is an irre- 
ducible unitary representation, and 

</.(7r;A+)GCc(A+)c(r)* 
comes from the infinitesimal character as in Corollary 8.6. Define 

A(7r;A+) = rp(RE</>(7r;A+)) 

(notation as in Proposition 1.4). 

a) The weight A(7r;A"'") belongs to the positive Weyl chamber Ck(A"'") C 
i(tS)* + (a3)*. 

b) The map 

n„(G) ^ Cm(A+), 7r^A(7r;A+) 

is continuous from the Fell topology to the standard topology on the cone 
of dominant weights. 
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c) Assume that Conjecture 5.7 holds, and that vr G 11^" (G) {Definition 0.2). 
Then 

i^A+(A«) = A(7r;A+) 

{notation as in (8.3a)). 

Proof. Because RE0(7r;A+) is dominant for A"'"(g, f)'^), Tp may be com- 
puted by subtracting p and projecting on the positive Weyl chamber. This 
proves (a). Part (b) follows from Corollary 8.6, the continuity of the maps 
in (8.3c and d), and the identification noted in Definition 8.1 of the quotient 
and subspace topologies on C]r{A~^). Part (c) is a reformulation of Theorem 
5.8(c). □ 

Corollary 8.8. Fix Xu € A„ (cf. (0.5e)). Choose representatives 
A^, . . . , AJ^ for the orbits of R{G) on 

w{Q,e)-XunAu. 

Assume that Conjecture 5.7 holds. 

a) The set (Ji=i (G) of unitary representations is open and closed in the 
Fell topology. 

A* A^ 

b) Suppose i j, and tt G Ilu"{G). Then tt contains no K -types in Bu^{G). 

c) Each set n„"(G) is open and closed in the Fell topology. 

d) The mapping 

n„(G) ^ Au/R{G), TT ^ A„(7r) 

{notation as in Definition 0.2) is continuous from the Fell topology to the 
natural {discrete) topology on the image. 

The statement of this corollary is a little cumbersome; part (c), for ex- 
ample, is obviously stronger than (a). The formulation is chosen to make the 
proof clearer. 

One might expect that (d) should be more or less a formal consequence 
of the definitions. To see why it is not, consider the analogous map 

(8.4) n„(G) ^ Aa/i?(G), 7r^Aa(7r) 

(notation as in (2.1) and Definition 2.5). The definition of Xa is formally very 
similar to that of A„; but the mapping in (8.4) is not continuous in the Fell 
topology. To see why, suppose G = SL(2, R), and let vr be the first holomorphic 
discrete series representation. In the notation of Example 6.2, the lowest K- 
type of TT is /X2, and Aa(7r) = 1. But there is a sequence {ttj} of spherical 
complementary series representations having tt as a limit point. (The reason 
is that TT appears as a composition factor in the reducible spherical principal 
series representation at the end of the complementary series.) Each ttj has 
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lowest K-type jiQ, so Xaij^j) = 0. So Aa(7rj) fails to converge to Aa(7r). (On 
the other hand, Example 6.2 shows that A„(7r) = = Au(7rj), so there is no 
contradiction to (d) in the corollary.) 

Proof. By Theorem 8.6(c), we have a continuous map 

n„(G) ^ (A„), vr ^ A(7r, A+) = (A„(^)). 

The range is discrete because is (cf. (0.5e)), and so carries the discrete 
topology. The set of unitary representations in (a) is just the preimage of 
^A+(A«), and so must be open and closed. Part (b) is immediate from Lemma 
5.5. 

For (c), it suffices to prove that each Ily^{G) is closed. So suppose {vr„} 

A^ 

is a sequence of representations in nu"(G), and that vr is a limit point. By (a), 

vr must belong to some n^(G); we want to show that i = j. Suppose not. By 

Definition 0.2, tt must contain a K-type r in K"(G). We can therefore form 
a corresponding nonzero matrix coefficient f^^; it transforms on the right and 
left by T under K. By the definition of the Fell topology, /,r may be uniformly 
approximated on compact sets by matrix coefficients of the representations 7r„. 
By (b), these representations do not contain r; and it follows easily that their 
matrix coefficients cannot approximate /tt. This contradiction proves (c). Part 
(d) is immediate from (c). □ 

Corollary 8.9. In the setting of Theorem 5.8, assume that Conjecture 
5.7 holds. Then the bijection 

/:5JAJ:^^(G(A„))^^^(G) 

is a homeomorphism in the Fell topology; the image is open and closed in 

n„(G). 

Sketch of proof . According to fundamental (and partly unpublished) work 
of Milicic, the Fell topology may be described in terms of the reducibility 
of certain parabolically induced representations. To be a little more precise, 
suppose P = MAN is a parabolic subgroup oi G, S E Ila{M) is an admissible 
representation, and 

(8.5a) u: [0, 1] ^ a* 

is a continuous map. Define a family of admissible representations by 
(8.5b) I{t) = Ind${S®iy{t)^l), {te[0,l]). 

Now we make the following assumption: 

(8.5c) For all t G [0, 1), the representation I{t) is irreducible and unitary. 
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Here by "unitary" we mean "infinitesimally equivalent to a unitary represen- 
tation." List the irreducible composition factors of the representation 7(1) as 
7i, /2, . . . ,Ir- As a consequence of assumption 8.5(c) and a theorem of Milicic, 
(see [11]), all of the representations Ij are unitary; and they are precisely the 
limit points of I{t) as t approaches 1: 

(8.5d) liml{t) = {h,...,lr}. 

Finally, every convergent sequence in the Fell topology has a subsequence con- 
structed in this way. 

By this description of the Fell topology, and the good behavior of Cs^{)^u) 
(in particular Theorem 5.4(e)), it is not difficult to prove the corollary. We 
omit the details. 

We make one final remark. All of the interesting results in this section 
depend on Conjecture 5.7; it is natural to ask what can be said absolutely. In 
the setting of Theorems 5.4 and 5.8, we can consider a certain subset 

(8.6a) ^^:good(G(A„))c^^(G(A„)) 

consisting of unitary representations for which the infinitesimal character (p{Z) 
satisfies 

(8.6b) RE (j){Z) e\u + {convex hull of W ■ p}; 

here both the Weyl group and p come from G(A„). The content of Conjecture 
5.7 is that this set is all of 11^" (G(Au)) ; but in any case it is a well-defined closed 
subset. The proof of Theorem 5.8 shows that Csui^u) defines a bijection from 
this set to a closed subset 

(8.6c) ^^:good(G)c^^(G). 

We define 

(8.6d) n,,good = UA^gA^n^^goodC^)' 

a closed subset of n„(G). Everything we have said about n„(G) using Con- 
jecture 5.7 applies unconditionally to n„^good(G). 
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